Model reference · open weights

DeepSeek

LLMs deepseek-ai Text gen 3 builds Open weights 1.4M dl/mo

DeepSeek is an open-weight language model from DeepSeek. DeepSeek-V3 (FP8) weighs 689 GB; the smallest configuration that runs it is 8× H200 141 GB.

  • DeepSeek-V3.2 is a text-generation model developed by DeepSeek that features 685.4B parameters and a context length of 163,840 tokens.
  • It is designed for high-efficiency reasoning and agentic tasks, utilizing a sparse attention mechanism to optimize long-context performance.
  • The model is released under the MIT license.

Summary of the deepseek-ai/DeepSeek-V3.2 model card, 2026-10-01. The estimate below is for another build of the family.

What it is

Released byDeepSeek
Released2025-12-01
Parameters685.4B
VRAM689 GB for the weights

What it runs on

Memory and cards for DeepSeek-V3 (FP8)

689 GBweights, file size
70 MBcache per 1K tokens
2.4 GBruntime overhead, at least
163,840 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB … 8× A100 80 GB
14 smaller cards
———
8× H200 141 GB
tensor parallel
7017all 160K138 GB a card
8× B200 180 GB
tensor parallel
12431all 160K176 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
1692 GB693 GB
5694 GB702 GB
8696 GB709 GB
16700 GB728 GB
32709 GB765 GB
64728 GB838 GB

One card, with vLLM's small-card settings.

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
DeepSeek-V3.2 ↗ 685.4BFP8 689 GB8× H200 141 GB
DeepSeek-V3 (above) ↗ 684.5BFP8 689 GB8× H200 141 GB
DeepSeek-V2 ↗ 235.7BBF16 471 GB4× H200 141 GB

From the model card

What DeepSeek says about DeepSeek

Read the model card

Introduction

We introduce DeepSeek-V3.2, a model that harmonizes high computational efficiency with superior reasoning and agent performance. Our approach is built upon three key technical breakthroughs:

  1. DeepSeek Sparse Attention (DSA): We introduce DSA, an efficient attention mechanism that substantially reduces computational complexity while preserving model performance, specifically optimized for long-context scenarios.
  2. Scalable Reinforcement Learning Framework: By implementing a robust RL protocol and scaling post-training compute, DeepSeek-V3.2 performs comparably to GPT-5. Notably, our high-compute variant, DeepSeek-V3.2-Speciale, surpasses GPT-5 and exhibits reasoning proficiency on par with Gemini-3.0-Pro.
    • Achievement: 🥇 Gold-medal performance in the 2025 International Mathematical Olympiad (IMO) and International Olympiad in Informatics (IOI).
  3. Large-Scale Agentic Task Synthesis Pipeline: To integrate reasoning into tool-use scenarios, we developed a novel synthesis pipeline that systematically generates training data at scale. This facilitates scalable agentic post-training, improving compliance and generalization in complex interactive environments.

We have also released the final submissions for IOI 2025, ICPC World Finals, IMO 2025 and CMO 2025, which were selected based on our designed pipeline. These materials are provided for the community to conduct secondary verification. The files can be accessed at assets/olympiad_cases.

Chat Template

DeepSeek-V3.2 introduces significant updates to its chat template compared to prior versions. The primary changes involve a revised format for tool calling and the introduction of a "thinking with tools" capability.

To assist the community in understanding and adapting to this new template, we have provided a dedicated encoding folder, which contains Python scripts and test cases demonstrating how to encode messages in OpenAI-compatible format into input strings for the model and how to parse the model's text output.

A brief example is illustrated below:

import transformers
# encoding/encoding_dsv32.py
from encoding_dsv32 import encode_messages, parse_message_from_completion_text

tokenizer = transformers.AutoTokenizer.from_pretrained("deepseek-ai/DeepSeek-V3.2")

messages = [
    {"role": "user", "content": "hello"},
    {"role": "assistant", "content": "Hello! I am DeepSeek.", "reasoning_content": "thinking..."},
    {"role": "user", "content": "1+1=?"}
]
encode_config = dict(thinking_mode="thinking", drop_thinking=True, add_default_bos_token=True)

# messages -> string
prompt = encode_messages(messages, **encode_config)
# Output: "helloHello! I am DeepSeek.1+1=?"

# string -> tokens
tokens = tokenizer.encode(prompt)
# Output: [0, 128803, 33310, 128804, 128799, 19923, 3, 342, 1030, 22651, 4374, 1465, 16, 1, 128803, 19, 13, 19, 127252, 128804, 128798]

Important Notes:

  1. This release does not include a Jinja-format chat template. Please refer to the Python code mentioned above.
  2. The output parsing function included in the code is designed to handle well-formatted strings only. It does not attempt to correct or recover from malformed output that the model might occasionally generate. It is not suitable for production use without robust error handling.
  3. A new role named developer has been introduced in the chat template. This role is dedicated exclusively to search agent scenarios and is designated for no other tasks. The official API does not accept messages assigned to developer.

How to Run Locally

The model structure of DeepSeek-V3.2 and DeepSeek-V3.2-Speciale are the same as DeepSeek-V3.2-Exp. Please visit DeepSeek-V3.2-Exp repo for more information about running this model locally.

Usage Recommendations:

  1. For local deployment, we recommend setting the sampling parameters to temperature = 1.0, top_p = 0.95.
  2. Please note that the DeepSeek-V3.2-Speciale variant is designed exclusively for deep reasoning tasks and does not support the tool-calling functionality.

License

This repository and the model weights are licensed under the MIT License.

Citation

@misc{deepseekai2025deepseekv32,
      title={DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models},
      author={DeepSeek-AI},
      year={2025},
}

Contact

If you have any questions, please raise an issue or contact us at service@deepseek.com.

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms