Llama-3.1-Nemotron-Nano-VL

About

What Llama-3.1-Nemotron-Nano-VL is

Llama-3.1-Nemotron-Nano-VL-8B-V1 Model Overview Description Llama Nemotron Nano VL is a leading document intelligence vision language model (VLMs) that enables the ability to query and summarize images from the physical or virtual world. Llama Nemotron Nano VL is deployable in the data center, cloud and at the edge, including Jetson Orin and laptop by AWQ 4bit quantization through TinyChat framework. We find: (1) image-text pairs are not enough, interleaved image-text is essential; (2) unfreezing LLM during interleaved image-text pre-training enables in-context learning; (3)re-blending text-only instruction data is crucial to boost both VLM and text-only performance. This model was trained on commercial images for all three stages of training and supports single image inference. License/Terms of Use Governing Terms: Your use of the model is governed by the NVIDIA Open License Agreement. Additional Information: Llama 3.1 Community Model License; Built with Llama. Additional Information: Llama 3.1 Community Model License; Built with Llama. Deployment Geography: Global Use Case: Customers: AI foundry enterprise customers Use Cases: Image summarization. Text-image analysis, Optical Character Recognition, Interactive Q&A on images, Text Chain-of-Thought reasoning Release Date: - Build.Nvidia.com [June 3rd, 2025] via nvidia/llama-3.1-nemotron-nano-vl-8b-v1 - Hugging Face [June 3rd, 2025] Model Architecture: Network Type: Transformer Network Architecture: Vision Encoder: C-RADIOv2-H Language Encoder: Llama-3.1-8B-Instruct Input Input Type(s): Image, Text - Input Images - Language Supported: English only Input Format(s): Image (Red, Green, Blue (RGB)), and Text (String) Input Parameters: Image (2D), Text (1D) Other Properties Related to Input: - Input + Output Token: 16K - Maximum Resolution: Determined by a 12-tile layout constraint, with each tile being 512 × 512 pixels. This supports aspect ratios such as: - 4 × 3 layout: up to 2048 × 1536 pixels - 3 × 4 layout: up to 1536 × 2048 pixels - 2 × 6 layout: up to 1024 × 3072 pixels - 6 × 2 layout: up to 3072 × 1024 pixels - Other configurations allowed, provided total tiles ≤ 12 - Channel Count: 3 channels (RGB) - Alpha C

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

How it works

How language models work

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys llama-3-1-nemotron-nano-vl for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (llama-3-1-nemotron-nano-vl below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"llama-3-1-nemotron-nano-vl","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Licence

Commercial licence needed

Sources

Weights & code

Explore

More language models