Model reference · open weights

NVIDIA-Nemotron-3-Nano

LLMs nvidia Text gen · MoE 4 builds Its own licence terms 876k dl/mo

NVIDIA-Nemotron-3-Nano is an open-weight language model from NVIDIA. NVIDIA-Nemotron-3-Nano-4B-BF16 (BF16) weighs 7.9 GB; the smallest configuration that runs it is RTX 3060 12 GB.

  • NVIDIA-Nemotron-3-Nano is a large language model developed by NVIDIA for text generation, reasoning, and agentic tasks.
  • It features a hybrid Mamba-2 and Mixture-of-Experts architecture with 30B total parameters and 3.5B active parameters.
  • The model supports a context length of up to 1M tokens and is available under the NVIDIA Nemotron Open Model License.

Summary of the nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 model card, 2026-10-01. The estimate below is for another build of the family.

What it is

Released byNVIDIA
Released2025-12-04
Parameters31.6B
VRAM7.9 GB for the weights

What it runs on

Memory and cards for NVIDIA-Nemotron-3-Nano-4B-BF16 (BF16)

7.9 GBweights, file size
16 MBcache per 1K tokens
168 MBfixed state per request
718 MBruntime overhead, at least
262,144 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB94165K11.6 GB
RTX 4060 Ti 16 GB229all 256K15.4 GB
RTX 3090 24 GB4820all 256K23.4 GB
RTX 4090 24 GB4820all 256K23.4 GB
RTX 5090 32 GB7431all 256K31.0 GB
L40S 48 GB11650all 256K44.0 GB
A100 80 GB23098all 256K78.2 GB
H100 80 GB21692all 256K78.1 GB
RTX PRO 6000 Blackwell 96 GB268115all 256K93.8 GB
DGX Spark (GB10) 128 GB unified313134all 256K107 GB
H200 141 GB414177all 256K138 GB
B200 180 GB539231all 256K176 GB
Memory needed at each load
Requests at once8K tokens each32K tokens each
19.0 GB9.4 GB
510.2 GB12.2 GB
811.1 GB14.3 GB
1613.5 GB19.9 GB
3218.3 GB31.2 GB
6428.0 GB53.8 GB

One card, with vLLM's small-card settings.

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 ↗ 31.6BBF16 63.2 GBH100 80 GB
NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 ↗ 31.6BFP8 32.7 GBL40S 48 GB
NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 ↗ 18.2BNVFP4 19.3 GB2× RTX 3060 12 GB
NVIDIA-Nemotron-3-Nano-4B-BF16 (above) ↗ 4.0BBF16 7.9 GBRTX 3060 12 GB

From the model card

What NVIDIA says about NVIDIA-Nemotron-3-Nano

Read the model card

Model Overview

Model Developer: NVIDIA Corporation

Model Dates:

September 2025 - December 2025

Data Freshness:

  • The post-training data has a cutoff date of November 28, 2025.
  • The pre-training data has a cutoff date of June 25, 2025.

Description

Nemotron-3-Nano-30B-A3B-BF16 is a large language model (LLM) trained from scratch by NVIDIA, and designed as a unified model for both reasoning and non-reasoning tasks. It responds to user queries and tasks by first generating a reasoning trace and then concluding with a final response. The model's reasoning capabilities can be configured through a flag in the chat template. If the user prefers the model to provide its final answer without intermediate reasoning traces, it can be configured to do so, albeit with a slight decrease in accuracy for harder prompts that require reasoning. Conversely, allowing the model to generate reasoning traces first generally results in higher-quality final solutions to queries and tasks.

The model employs a hybrid Mixture-of-Experts (MoE) architecture, consisting of 23 Mamba-2 and MoE layers, along with 6 Attention layers. Each MoE layer includes 128 experts plus 1 shared expert, with 6 experts activated per token. The model has 3.5B active parameters and 30B parameters in total.

The supported languages include: English, German, Spanish, French, Italian, and Japanese. Improved using Qwen.

This model is ready for commercial use.

What is Nemotron?

NVIDIA Nemotron™ is a family of open models with open weights, training data, and recipes, delivering leading efficiency and accuracy for building specialized AI agents.

To get started, you can use our quickstart guide below.

License/Terms of Use

Governing Terms: Use of this model is governed by the NVIDIA Nemotron Open Model License.

Reasoning Benchmark Evaluations

We evaluated our model on the following benchmarks:

TaskNVIDIA-Nemotron-3-Nano-30B-A3B-BF16Qwen3-30B-A3B-Thinking-2507GPT-OSS-20B
General Knowledge
MMLU-Pro78.380.975.0
Reasoning
AIME25 (no tools)89.185.091.7
AIME25 (with tools)99.2-98.7
GPQA (no tools)73.073.471.5
GPQA (with tools)75.0-74.2
LiveCodeBench (v6 2025-08–2025-05)68.366.061.0
SciCode (subtask)33.333.034.0
HLE (no tools)10.69.810.9
HLE (with tools)15.5-17.3
MiniF2F pass@150.05.712.1
MiniF2F pass@3279.916.843.0
Agentic
Terminal Bench (hard subset)8.55.06.0
SWE-Bench (OpenHands)38.822.034.0
TauBench V2 (Airline)48.058.038.0
TauBench V2 (Retail)56.958.838.0
TauBench V2 (Telecom)42.226.349.7
TauBench V2 (Average)49.047.748.7
BFCL v453.846.4*-
Chat & Instruction Following
IFBench (prompt)71.551.065.0
Scale AI Multi Challenge38.544.833.8
Arena-Hard-V2 (Hard Prompt)72.149.6*71.2*
Arena-Hard-V2 (Creative Writing)63.266.0*25.9&
Arena-Hard-V2 (Average)67.757.848.6
Long Context
AA-LCR35.959.034.0
RULER-100@256k92.989.4-
RULER-100@512k91.384.0-
RULER-100@1M86.377.5-
Multilingual
MMLU-ProX (avg over langs)59.577.6*69.1*
WMT24++ (en->xx)86.285.683.2

All evaluation results were collected via Nemo Evaluator SDK and Nemo Skills. The open source container on Nemo Skills packaged via NVIDIA’s Nemo Evaluator SDK used for evaluations can be found here. In addition to Nemo Skills, the evaluations also used dedicated packaged containers for Tau-2 Bench, ArenaHard v2, AA_LCR. A reproducibility tutorial along with all configs can be found in Nemo Evaluator SDK examples. The configs are also available in this HF repo here. * denotes the accuracy numbers are measured by us.

Deployment Geography: Global

Use Case

NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 is a general purpose reasoning and chat model intended to be used in English and coding languages. Other non-English languages (English, Spanish, French, German, Japanese, Italian) are also supported. This model is intended to be used by developers designing AI Agent systems, chatbots, RAG systems, and other AI-powered applications. This model is also suitable for typical instruction-following tasks.

Release Date

December 15, 2025 via Hugging Face

Reference(s)

Model Architecture

  • Architecture Type: Mamba2-Transformer Hybrid Mixture of Experts (MoE)
  • Network Architecture: Nemotron Hybrid MoE
  • Number of model parameters: 30B

Model Design

The model was trained with 25T tokens, with a batch si

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms