Model reference · open weights
NVIDIA-Nemotron-3-Nano is an open-weight language model from NVIDIA. NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 (FP8) weighs 32.7 GB; the smallest configuration that runs it is L40S 48 GB.
Summary of the nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 model card, 2026-10-01. The estimate below is for another build of the family.
What it is
| Released by | NVIDIA |
|---|---|
| Released | 2025-12-04 |
| Parameters | 31.6B |
| VRAM | 32.7 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB … RTX 5090 32 GB 5 smaller cards | — | — | — | |
| L40S 48 GB | 66 | 33 | all 256K | 44.0 GB |
| A100 80 GB FP8 without its speed-up here | 297 | 147 | all 256K | 78.2 GB |
| H100 80 GB | 255 | 126 | all 256K | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | 361 | 179 | all 256K | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | 452 | 224 | all 256K | 107 GB |
| H200 141 GB | 658 | 326 | all 256K | 138 GB |
| B200 180 GB | 894 | 443 | all 256K | 176 GB |
| 2× RTX 4090 24 GB tensor parallel | 75 | 37 | all 256K | 23.4 GB a card |
| 2× RTX 3090 24 GB tensor parallel · FP8 without its speed-up here | 76 | 37 | all 256K | 23.4 GB a card |
| 2× RTX 5090 32 GB tensor parallel | 179 | 88 | all 256K | 31.0 GB a card |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 34.2 GB | 34.4 GB |
| 5 | 34.8 GB | 35.6 GB |
| 8 | 35.3 GB | 36.5 GB |
| 16 | 36.4 GB | 38.9 GB |
| 32 | 38.8 GB | 43.7 GB |
| 64 | 43.6 GB | 53.2 GB |
One card, with vLLM's small-card settings.
Builds
| Build | Params | Precision | Weights | Smallest setup |
|---|---|---|---|---|
| NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 ↗ | 31.6B | BF16 | 63.2 GB | H100 80 GB |
| NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 (above) ↗ | 31.6B | FP8 | 32.7 GB | L40S 48 GB |
| NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 ↗ | 18.2B | NVFP4 | 19.3 GB | 2× RTX 3060 12 GB |
| NVIDIA-Nemotron-3-Nano-4B-BF16 ↗ | 4.0B | BF16 | 7.9 GB | RTX 3060 12 GB |
From the model card
Model Developer: NVIDIA Corporation
Model Dates:
September 2025 - December 2025
Data Freshness:
Nemotron-3-Nano-30B-A3B-BF16 is a large language model (LLM) trained from scratch by NVIDIA, and designed as a unified model for both reasoning and non-reasoning tasks. It responds to user queries and tasks by first generating a reasoning trace and then concluding with a final response. The model's reasoning capabilities can be configured through a flag in the chat template. If the user prefers the model to provide its final answer without intermediate reasoning traces, it can be configured to do so, albeit with a slight decrease in accuracy for harder prompts that require reasoning. Conversely, allowing the model to generate reasoning traces first generally results in higher-quality final solutions to queries and tasks.
The model employs a hybrid Mixture-of-Experts (MoE) architecture, consisting of 23 Mamba-2 and MoE layers, along with 6 Attention layers. Each MoE layer includes 128 experts plus 1 shared expert, with 6 experts activated per token. The model has 3.5B active parameters and 30B parameters in total.
The supported languages include: English, German, Spanish, French, Italian, and Japanese. Improved using Qwen.
This model is ready for commercial use.
NVIDIA Nemotron™ is a family of open models with open weights, training data, and recipes, delivering leading efficiency and accuracy for building specialized AI agents.
To get started, you can use our quickstart guide below.
Governing Terms: Use of this model is governed by the NVIDIA Nemotron Open Model License.
We evaluated our model on the following benchmarks:
| Task | NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | Qwen3-30B-A3B-Thinking-2507 | GPT-OSS-20B |
|---|---|---|---|
| General Knowledge | |||
| MMLU-Pro | 78.3 | 80.9 | 75.0 |
| Reasoning | |||
| AIME25 (no tools) | 89.1 | 85.0 | 91.7 |
| AIME25 (with tools) | 99.2 | - | 98.7 |
| GPQA (no tools) | 73.0 | 73.4 | 71.5 |
| GPQA (with tools) | 75.0 | - | 74.2 |
| LiveCodeBench (v6 2025-08–2025-05) | 68.3 | 66.0 | 61.0 |
| SciCode (subtask) | 33.3 | 33.0 | 34.0 |
| HLE (no tools) | 10.6 | 9.8 | 10.9 |
| HLE (with tools) | 15.5 | - | 17.3 |
| MiniF2F pass@1 | 50.0 | 5.7 | 12.1 |
| MiniF2F pass@32 | 79.9 | 16.8 | 43.0 |
| Agentic | |||
| Terminal Bench (hard subset) | 8.5 | 5.0 | 6.0 |
| SWE-Bench (OpenHands) | 38.8 | 22.0 | 34.0 |
| TauBench V2 (Airline) | 48.0 | 58.0 | 38.0 |
| TauBench V2 (Retail) | 56.9 | 58.8 | 38.0 |
| TauBench V2 (Telecom) | 42.2 | 26.3 | 49.7 |
| TauBench V2 (Average) | 49.0 | 47.7 | 48.7 |
| BFCL v4 | 53.8 | 46.4* | - |
| Chat & Instruction Following | |||
| IFBench (prompt) | 71.5 | 51.0 | 65.0 |
| Scale AI Multi Challenge | 38.5 | 44.8 | 33.8 |
| Arena-Hard-V2 (Hard Prompt) | 72.1 | 49.6* | 71.2* |
| Arena-Hard-V2 (Creative Writing) | 63.2 | 66.0* | 25.9& |
| Arena-Hard-V2 (Average) | 67.7 | 57.8 | 48.6 |
| Long Context | |||
| AA-LCR | 35.9 | 59.0 | 34.0 |
| RULER-100@256k | 92.9 | 89.4 | - |
| RULER-100@512k | 91.3 | 84.0 | - |
| RULER-100@1M | 86.3 | 77.5 | - |
| Multilingual | |||
| MMLU-ProX (avg over langs) | 59.5 | 77.6* | 69.1* |
| WMT24++ (en->xx) | 86.2 | 85.6 | 83.2 |
All evaluation results were collected via Nemo Evaluator SDK and Nemo Skills. The open source container on Nemo Skills packaged via NVIDIA’s Nemo Evaluator SDK used for evaluations can be found here. In addition to Nemo Skills, the evaluations also used dedicated packaged containers for Tau-2 Bench, ArenaHard v2, AA_LCR. A reproducibility tutorial along with all configs can be found in Nemo Evaluator SDK examples. The configs are also available in this HF repo here. * denotes the accuracy numbers are measured by us.
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 is a general purpose reasoning and chat model intended to be used in English and coding languages. Other non-English languages (English, Spanish, French, German, Japanese, Italian) are also supported. This model is intended to be used by developers designing AI Agent systems, chatbots, RAG systems, and other AI-powered applications. This model is also suitable for typical instruction-following tasks.
December 15, 2025 via Hugging Face
The model was trained with 25T tokens, with a batch si
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.