North-Micro-Vision

About

What North-Micro-Vision is

North Micro Vision Instruct North Micro Vision Instruct is a 2.4B-parameter open-weight vision-language model with native-resolution image support, released under the Apache 2.0 license. It is designed as a compact foundation for prototyping, task-specific fine-tuning, and specialized multimodal applications. Developed by Cohere. Technical deep dive: Read the North Micro Vision technical blog post for architecture, training, and evaluation details. Highlights - Native-resolution image processing that preserves aspect ratios and fine visual detail. - Broad image-understanding capabilities across VQA, captioning, grounding, OCR, charts, and documents. - Multilingual and multi-image support. - Compact 2.4B-parameter scale suited to customization and deployment experimentation. - Apache 2.0-licensed model weights. Model Details The language backbone supports a 128K-token context window, but the validated operating range for multimodal prompts is up to 8K tokens. Longer multimodal contexts may rely on extrapolation and have not been benchmarked. Quickstart Installation Install PyTorch for your platform first. North Micro Vision requires Transformers 5.16.0, together with accelerate for automatic device placement and Pillow for image loading. Until Transformers 5.16.0 is released, install the runtime dependencies and Transformers from source: Once Transformers 5.16.0 is available on PyPI, install the released package with: Flash Attention 2 is optional. On supported CUDA systems, install it with: If you do not use uv, replace uv pip with pip in the commands above. Transformers The following example loads an image from a URL and asks the model to describe it. Prompts can interleave text with one or more images; for text-only prompts, omit the image entries. The example uses the recommended Transformers sampling settings. For deterministic output, set dosample=False and omit temperature, topp, and topk. Architecture North Micro Vision combines a custom-trained 400M-parameter native-resolution vision encoder with an in-house 2B-parameter language model North Micro LLM. The language model follows our Command A+ architecture, interleaving three sliding-window attention lay

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

How it works

How language models work

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys north-micro-vision for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (north-micro-vision below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"north-micro-vision","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Licence

Open weights

Sources

Weights & code

Explore

More language models