NVIDIA-Nemotron-3.5-Lightning

About

What NVIDIA-Nemotron-3.5-Lightning is

Read our How to Run Nemotron 3.5 Guide! NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 Model Summary Model Overview Model Developer: NVIDIA Corporation Model Dates: December 2025 - May 2026 Data Freshness: The pre-training data has a cutoff date of September 2025. The post-training data has a cutoff date of May 2026. What is Nemotron? NVIDIA Nemotron™ is a family of open models with open weights, training data, and recipes, delivering leading efficiency and accuracy for building specialized AI agents. Description NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 is a large language model (LLM) trained by NVIDIA. This is the full-precision (BF16) release of Nemotron 3.5 Lightning — the reference weights of the model, intended primarily as the starting point for customization: post-training (SFT, RL, distillation), domain adaptation, and producing your own quantized or GGUF variants. For latency- and throughput-optimized inference, use the NVFP4 release instead. The model employs a hybrid Mixture-of-Experts architecture, utilizing interleaved Mamba-2 and MoE layers, along with select Attention layers. The Lightning 3.5 model is released alongside a number of speculative decoding methods for faster text generation. The model has 3B active parameters and 30B parameters in total. This model is ready for commercial use. Quick Start For running Nemotron 3.5 Lightning fast — with NVFP4 quantization, W4A16 for broad hardware coverage, and the DSpark recipe for DGX Spark — please see: NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4 To get quickly started on a single H100 you can use the following command. Grab the model: Run it with vLLM! (vLLM Nightly: vllm/vllm-openai:v0.27.1) For more details on how to deploy and use the model — see the Quick Start Guide below! License/Terms of Use Governing Download Terms: Use of this model is governed by the OpenMDW-1.1 model license. Benchmarks Reasoning Benchmark Evaluations We evaluated our model on the following benchmarks: Accuracy numbers measured by NVIDIA under a consistent harness (NeMo Gym / Nemo Evaluator SDK); they may differ from vendors' self-reported numbers. For reproducibility, the evaluation recipes, installation instructions, and

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

How it works

How language models work

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys unsloth-nvidia-nemotron-3-5-lightning for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (unsloth-nvidia-nemotron-3-5-lightning below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"unsloth-nvidia-nemotron-3-5-lightning","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Licence

Commercial licence needed

Sources

Weights & code

Explore

More language models