Model reference · open weights

Qwen3.8-2.4T

Qwen3.8-2.4T is an open-weight language model from nvidia, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.

NEW · released this week Licence fee required LLMs nvidia 1 variants 438 downloads/mo
Request a licence + hosting quote All served models Not on the shared API today — deployed on request.

About

What Qwen3.8-2.4T is

Model Overview Description: Qwen3.8 delivers substantial gains across coding, professional work, research, and long-horizon agentic tasks. The NVIDIA Qwen3.8-2.4T-A95B-NVFP4 model is the quantized version of Alibaba's Qwen3.8-2.4T-A95B model.For more information, please check here. The NVIDIA Qwen3.8-2.4T-A95B-NVFP4 model is quantized with Model Optimizer. This model is ready for commercial or non-commercial use. <br Third-Party Community Consideration This model is not owned or developed by NVIDIA. This model has been developed and built to a third-party's requirements for this application and use case; see link to Non-NVIDIA (Qwen3.8-2.4T-A95B) Model Card. License/Terms of Use: GOVERNING TERMS: Use of the model is governed by the NVIDIA Open Model Agreement. Additional Information: Qwen3.8-2.4T-A95B Use Case: Qwen3.8-2.4T-A95B delivers comprehensive improvements across coding, work, research, and long-horizon tasks. <br Release Date: Hugging Face 08/27/2026 via https://huggingface.co/nvidia/Qwen3.8-2.4T-A95B-NVFP4 <br References - NVIDIA Model Optimizer: https://github.com/NVIDIA/Model-Optimizer - Qwen3.8-2.4T-A95B model card Deployment Geography: Global <br Model Architecture: Architecture Type: Transformers <br Network Architecture: Mixture-of-Experts (MoE) with Hybrid Attention and fine-grained MoE blocks <br Number of Model Parameters: 2.4T in total and 95B activated <br Input: Input Type(s): Text <br Input Format(s): String <br Input Parameters: One-Dimensional (1D) <br Other Properties Related to Input: Context length up to 1 million tokens <br Output: Output Type(s): Text <br Output Format: String <br Output Parameters: One-Dimensional (1D): Sequences <br Other Properties Related to Output: Outputs may include natural-language responses, code, tool-calling content, and structured outputs depending on deployment configuration and application-level tooling. <br Our AI models are designed and/or optimized to run on NVIDIA GPU-accelerated systems. By leveraging NVIDIA's hardware (e.g. GPU cores) and software frameworks (e.g., CUDA libraries), the model achieves faster training and inference times compared to CPU-only solutions. <br Software Integration: Sup

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

Makernvidia
TypeLanguage models
Parameters (lead)1260.8B
Variants1
Runs withModel Optimizer
Based onQwen/Qwen3.8-2.4T-A95B
Released2026-08-25
Popularity438 downloads / month
Likes8
LicenceCommercial licence needed

How it works

How language models work

Your prompttext / messagesTransformerattention over tokensNext-token loopgenerate + streamResponsetext · tool callsA language model reads your tokens and predicts the next one, again and again, streaming the reply back.

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

VariantParamsPrecisionVRAMFits 16 GBWeights
Qwen3.8-2.4T-A95B-NVFP41260.8BNVFP4Weights ↗

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys nvidia-qwen3-8-2-4t for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (nvidia-qwen3-8-2-4t below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"nvidia-qwen3-8-2-4t","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Tags

Model Optimizer safetensors qwen3_5_moe_text NVIDIA ModelOpt Qwen3.8 quantized 4-bit precision FP4 fp4 text-generation conversational 8-bit modelopt

Licence

Commercial licence needed

The weights are open but its licence needs a commercial agreement for business use. AxForge can arrange that licence and host the model for you — you pay AxForge, we settle with the model’s maker. Ask us for a quote. Read the licence ↗

Sources

Weights & code

Want Qwen3.8-2.4T on EU-owned hardware?

Request a licence + hosting quote See what’s served now

Explore

More language models

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms