Model reference · open weights
NVIDIA-Nemotron-3-Super is an open-weight language model from NVIDIA. NVIDIA-Nemotron-3-Super-120B-A12B-BF16 (BF16) weighs 247 GB; the smallest configuration that runs it is 4× A100 80 GB.
Summary of the nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 model card, 2026-10-01. The estimate below is for another build of the family.
What it is
| Released by | NVIDIA |
|---|---|
| Released | 2026-03-10 |
| Parameters | 67.2B |
| VRAM | 247 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB … B200 180 GB 12 smaller cards | — | — | — | |
| 4× A100 80 GB tensor parallel | 96 | 52 | all 256K | 78.2 GB a card |
| 2× B200 180 GB tensor parallel | 66 | 44 | all 256K | 176 GB a card |
| 4× RTX PRO 6000 Blackwell 96 GB tensor parallel | 87 | 47 | all 256K | 93.8 GB a card |
| 4× H200 141 GB tensor parallel | 459 | 248 | all 256K | 138 GB a card |
| 8× H100 80 GB tensor parallel | 336 | 144 | all 256K | 78.1 GB a card |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 253 GB | 253 GB |
| 5 | 254 GB | 255 GB |
| 8 | 255 GB | 257 GB |
| 16 | 259 GB | 262 GB |
| 32 | 265 GB | 272 GB |
| 64 | 278 GB | 291 GB |
One card, with vLLM's small-card settings.
Builds
| Build | Params | Precision | Weights | Smallest setup |
|---|---|---|---|---|
| NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 ↗ | 67.2B | NVFP4 | 80.3 GB | DGX Spark (GB10) 128 GB unified |
| NVIDIA-Nemotron-3-Super-120B-A12B-BF16 (above) ↗ | 123.6B | BF16 | 247 GB | 4× A100 80 GB |
| NVIDIA-Nemotron-3-Super-120B-A12B-FP8 ↗ | 123.6B | FP8 | 128 GB | 2× A100 80 GB |
From the model card
| Total Parameters | 120B (12B active) |
| Architecture | LatentMoE - Mamba-2 + MoE + Attention hybrid with Multi-Token Prediction (MTP) |
| Context Length | Up to 1M tokens |
| Minimum GPU Requirement | 1× B200 OR 1× DGX Spark |
| Supported Languages | English, French, German, Italian, Japanese, Spanish, Chinese |
| Best For | Agentic workflows, long-context reasoning, high-volume workloads (e.g. IT ticket automation), tool use, RAG |
| Reasoning Mode | Configurable on/off via chat template (enable_thinking=True/False) |
| Speculative Decoding | Includes a built-in MTP head, with an updated MTPv2 head available as a separate checkpoint |
| License | NVIDIA Nemotron Open Model License |
| Release Date | March 11, 2026 |
Use
temperature=1.0andtop_p=0.95across all tasks and serving backends — reasoning, tool calling, and general chat alike.
For more details on how to deploy and use the model - see the Quick Start Guide below!
Model Developer: NVIDIA Corporation
Model Dates: December 2025 - March 2026
Data Freshness:
NVIDIA Nemotron™ is a family of open models with open weights, training data, and recipes, delivering leading efficiency and accuracy for building specialized AI agents.
Nemotron-3-Super-120B-A12B-NVFP4 is a large language model (LLM) trained by NVIDIA, designed to deliver strong agentic, reasoning, and conversational capabilities. It is optimized for collaborative agents and high-volume workloads such as IT ticket automation. Like other models in the family, it responds to user queries and tasks by first generating a reasoning trace and then concluding with a final response. The model's reasoning capabilities can be configured through a flag in the chat template.
The model employs a hybrid Latent Mixture-of-Experts (LatentMoE) architecture, utilizing interleaved Mamba-2 and MoE layers, along with select Attention layers. Distinct from the Nano model, the Super model incorporates Multi-Token Prediction (MTP) layers for faster text generation and improved quality, and it is trained using NVFP4 quantization to maximize compute efficiency. The model has 12B active parameters and 120B parameters in total.
The supported languages include: English, French, German, Italian, Japanese, Spanish, and Chinese
This model is ready for commercial use.
Governing Download Terms: Use of this model is governed by the NVIDIA Nemotron Open Model License.
Governing Download Terms with NIM: The NIM container is governed by the NVIDIA Software License Agreement and Product-Specific Terms for AI Products. Use of this model is governed by the NVIDIA Nemotron Open Model License.
| Benchmark | Nemotron-3-Super | Nemotron-3-Super FP8 | Nemotron-3-Super NVFP4 |
|---|---|---|---|
| General Knowledge | |||
| MMLU-Pro | 83.73 | 83.63 | 83.33 |
| Reasoning | |||
| HMMT Feb25 (with tools) | 94.73 | 94.38 | 95.36 |
| GPQA (no tools) | 79.23 | 79.36 | 79.42 |
| LiveCodeBench (v6 2024-08↔2025-05) | 78.69 | 78.44 | 78.44 |
| LiveCodeBench (v5 2024-07↔2024-12) | 81.19 | 80.99 | 80.56 |
| SciCode (subtask) | 42.05 | 41.38 | 40.83 |
| HLE (no tools) | 18.26 | 17.42 | 17.42 |
| Agentic | |||
| Terminal Bench (hard subset) | 25.78 | 26.04 | 24.48 |
| TauBench V2 | |||
| Airline | 56.25 | 56.25 | 54.75 |
| Retail | 62.83 | 63.05 | 63.38 |
| Telecom | 64.36 | 63.93 | 63.27 |
| Average | 61.15 | 61.07 | 60.46 |
| Chat & Instruction Following | |||
| IFBench (prompt) | 72.58 | 72.32 | 73.30 |
| Scale AI Multi-Challenge | 55.23 | 54.35 | 52.8 |
| Arena-Hard-V2 (Hard Prompt) | 73.88 | 76.06 | 76.00 |
| Long Context | |||
| AA-LCR | 58.31 | 57.69 | 58.06 |
| RULER-500 @ 128k (500 samples per task) | 96.79 | 96.85 | 95.99 |
| RULER-500 @ 256k (500 samples per task) | 96.60 | 96.33 | 96.52 |
| RULER-500 @ 512k (500 samples per task) | 96.09 | 95.66 | 96.23 |
| Multilingual | |||
| MMLU-ProX (avg over languages) | 79.35 | 79.21 | 79.37 |
All evaluation results were collected via Nemo Evaluator SDK and for most benchmarks, the Nemo Skills Harness. For reproducibility purposes, more details on the evaluation settings can be found in the Nemo Evaluator SDK configs folder and the reproducibility tutorial for Nemotron 3 Super. The open source container on Nemo Skills packaged via NVIDIA's Nemo Evaluator SDK used for evaluations can be found here. In addition to Nemo Skills, the evaluations also used dedicated open-source packaged containers for Tau-2 Bench (default prompt), Terminal Bench Hard (48 tasks), ScaleAI Multi Challenge Multi-turn Instruction Following, and Ruler.
The following benchmarks are not
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.