Llama-3_3-Nemotron-Super

About

What Llama-3_3-Nemotron-Super is

Llama-3.3-Nemotron-Super-49B-v1 Model Overview Llama-3.3-Nemotron-Super-49B-v1 is a large language model (LLM) which is a derivative of Meta Llama-3.3-70B-Instruct (AKA the reference model). It is a reasoning model that is post trained for reasoning, human chat preferences, and tasks, such as RAG and tool calling. The model supports a context length of 128K tokens. Llama-3.3-Nemotron-Super-49B-v1 is a model which offers a great tradeoff between model accuracy and efficiency. Efficiency (throughput) directly translates to savings. Using a novel Neural Architecture Search (NAS) approach, we greatly reduce the model’s memory footprint, enabling larger workloads, as well as fitting the model on a single GPU at high workloads (H200). This NAS approach enables the selection of a desired point in the accuracy-efficiency tradeoff. For more information on the NAS approach, please refer to this paper. The model underwent a multi-phase post-training process to enhance both its reasoning and non-reasoning capabilities. This includes a supervised fine-tuning stage for Math, Code, Reasoning, and Tool Calling as well as multiple reinforcement learning (RL) stages using REINFORCE (RLOO) and Online Reward-aware Preference Optimization (RPO) algorithms for both chat and instruction-following. The final model checkpoint is obtained after merging the final SFT and Online RPO checkpoints. For more details on how the model was trained, please see our technical report and blog. This model is part of the Llama Nemotron Collection. You can find the other model(s) in this family here: - Llama-3.1-Nemotron-Nano-8B-v1 - Llama-3.1-Nemotron-Ultra-253B-v1 This model is ready for commercial use. Feature Voting We want to hear from you! Share your ideas, vote on what matters, and help shape the future of Nemotron. License/Terms of Use GOVERNING TERMS: Your use of this model is governed by the NVIDIA Open Model License. \ Additional Information: Llama 3.3 Community License Agreement. Built with Llama. Model Developer: NVIDIA Model Dates: Trained between November 2024 and February 2025 Data Freshness: The pretraining data has a cutoff of 2023 per Meta Llama 3.3 70B Use Case: <br Developers design

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

How it works

How language models work

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys llama-3-3-nemotron-super for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (llama-3-3-nemotron-super below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"llama-3-3-nemotron-super","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Papers

Licence

Commercial licence needed

Sources

Weights & code

Explore

More language models