Model reference · open weights
DeepSeek is an open-weight language model from DeepSeek. DeepSeek-V3.2 (FP8) weighs 689 GB; the smallest configuration that runs it is 8× H200 141 GB.
Summary of the deepseek-ai/DeepSeek-V3.2 model card, 2026-10-01
What it is
| Released by | DeepSeek |
|---|---|
| Released | 2025-12-01 |
| Parameters | 685.4B |
| VRAM | 689 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB … 8× A100 80 GB 14 smaller cards | — | — | — | |
| 8× H200 141 GB tensor parallel | 62 | 15 | all 160K | 138 GB a card |
| 8× B200 180 GB tensor parallel | 111 | 27 | all 160K | 176 GB a card |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 692 GB | 694 GB |
| 5 | 695 GB | 705 GB |
| 8 | 697 GB | 712 GB |
| 16 | 702 GB | 733 GB |
| 32 | 712 GB | 774 GB |
| 64 | 733 GB | 856 GB |
One card, with vLLM's small-card settings.
Builds
| Build | Params | Precision | Weights | Smallest setup |
|---|---|---|---|---|
| DeepSeek-V3.2 (above) ↗ | 685.4B | FP8 | 689 GB | 8× H200 141 GB |
| DeepSeek-V3 ↗ | 684.5B | FP8 | 689 GB | 8× H200 141 GB |
| DeepSeek-V2 ↗ | 235.7B | BF16 | 471 GB | 4× H200 141 GB |
From the model card
We introduce DeepSeek-V3.2, a model that harmonizes high computational efficiency with superior reasoning and agent performance. Our approach is built upon three key technical breakthroughs:
We have also released the final submissions for IOI 2025, ICPC World Finals, IMO 2025 and CMO 2025, which were selected based on our designed pipeline. These materials are provided for the community to conduct secondary verification. The files can be accessed at assets/olympiad_cases.
DeepSeek-V3.2 introduces significant updates to its chat template compared to prior versions. The primary changes involve a revised format for tool calling and the introduction of a "thinking with tools" capability.
To assist the community in understanding and adapting to this new template, we have provided a dedicated encoding folder, which contains Python scripts and test cases demonstrating how to encode messages in OpenAI-compatible format into input strings for the model and how to parse the model's text output.
A brief example is illustrated below:
import transformers
# encoding/encoding_dsv32.py
from encoding_dsv32 import encode_messages, parse_message_from_completion_text
tokenizer = transformers.AutoTokenizer.from_pretrained("deepseek-ai/DeepSeek-V3.2")
messages = [
{"role": "user", "content": "hello"},
{"role": "assistant", "content": "Hello! I am DeepSeek.", "reasoning_content": "thinking..."},
{"role": "user", "content": "1+1=?"}
]
encode_config = dict(thinking_mode="thinking", drop_thinking=True, add_default_bos_token=True)
# messages -> string
prompt = encode_messages(messages, **encode_config)
# Output: "helloHello! I am DeepSeek.1+1=?"
# string -> tokens
tokens = tokenizer.encode(prompt)
# Output: [0, 128803, 33310, 128804, 128799, 19923, 3, 342, 1030, 22651, 4374, 1465, 16, 1, 128803, 19, 13, 19, 127252, 128804, 128798]
Important Notes:
developer has been introduced in the chat template. This role is dedicated exclusively to search agent scenarios and is designated for no other tasks. The official API does not accept messages assigned to developer.The model structure of DeepSeek-V3.2 and DeepSeek-V3.2-Speciale are the same as DeepSeek-V3.2-Exp. Please visit DeepSeek-V3.2-Exp repo for more information about running this model locally.
Usage Recommendations:
temperature = 1.0, top_p = 0.95.This repository and the model weights are licensed under the MIT License.
@misc{deepseekai2025deepseekv32,
title={DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models},
author={DeepSeek-AI},
year={2025},
}
If you have any questions, please raise an issue or contact us at service@deepseek.com.
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.