Model reference · open weights

DeepSeek-Pro-0813

LLMs deepseek-ai Text gen 3 builds Open weights 127k dl/mo

DeepSeek-Pro-0813 is an open-weight language model from DeepSeek. DeepSeek-V4-Pro-0813-NVFP4 (NVFP4) weighs 941 GB; the smallest configuration that runs it is 8× H200 141 GB.

  • DeepSeek-Pro-0813 is a text-generation model developed by DeepSeek that features a DSpark speculative decoding module.
  • It has 1650.5B parameters, supports a context length of 1048576 tokens, and is released under the MIT license.

Summary of the deepseek-ai/DeepSeek-V4-Pro-0813 model card, 2026-10-01. The estimate below is for another build of the family.

What it is

Released byDeepSeek
Released2026-08-13
Parameters1650.5B
VRAM941 GB for the weights

What it runs on

Memory and cards for DeepSeek-V4-Pro-0813-NVFP4 (NVFP4)

941 GBweights, file size
125 MBcache per 1K tokens
2.1 GBruntime overhead, at least
1,048,576 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB … 8× A100 80 GB
14 smaller cards
———
8× H200 141 GB
tensor parallel · FP4 without its speed-up here
9279K138 GB a card
8× B200 180 GB
tensor parallel
4110331K176 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
1944 GB947 GB
5948 GB964 GB
8951 GB976 GB
16960 GB1009 GB
32976 GB1074 GB
641009 GB1205 GB

One card, with vLLM's small-card settings.

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
DeepSeek-V4-Pro-0813 ↗ 1650.5BFP8 893 GB8× H200 141 GB
DeepSeek-V4-Pro-0813 ↗
packaged by unsloth
1650.5BFP8 893 GB8× H200 141 GB
DeepSeek-V4-Pro-0813-NVFP4 (above) ↗
packaged by nvidia
1650.5BNVFP4 941 GB8× H200 141 GB

From the model card

What DeepSeek says about DeepSeek-Pro-0813

Read the model card

Introduction

DeepSeek-V4-Pro-0813 is the official release of DeepSeek-V4-Pro, superseding the preview version, with greatly enhanced agentic capabilities and performance improvements that are especially pronounced in production environments. It is built on the DeepSeek-V4-Pro (Preview) model structure, with a DSpark speculative decoding module attached.

DeepSeek-V4-Pro-0813 outperforms DeepSeek-V4-Pro (Preview) on the benchmarks listed below, and is broadly competitive with the strongest proprietary models available.

BenchmarkDeepSeek-V4-Pro-0813DeepSeek-V4-Flash-0731DeepSeek-V4-Pro (Preview)DeepSeek-V4-Flash (Preview)GLM-5.2Kimi K3Opus-4.8Fable-5 (w/ fallback)
HLE (wo / w tools)42.7 / 60.037.8 / 51.537.7 / 48.234.8 / 45.140.5 / 54.743.5 / 56.049.8 / 57.953.3 / 63.0
Terminal Bench 2.187.982.772.161.881.088.385.088.0
NL2Repo61.554.238.539.448.9-69.7-
Cybergym83.376.752.738.7-80.078.383.1
DeepSWE62.754.412.87.346.267.558.070.0
Toolathlon-Verified74.170.355.949.759.976.576.277.9
Agents' Last Exam25.725.216.515.823.827.625.7-
AutomationBench (Public)31.825.112.810.812.930.827.229.1
DSBench-FullStack †71.168.741.837.061.873.771.677.2
DSBench-Hard †67.259.631.125.854.563.071.768.3

Notes:

  1. For the code-agent tasks among the public benchmarks above, DeepSeek-V4-Pro-0813 is evaluated with the minimal mode of DeepSeek Harness as the agent framework, using the max reasoning effort level with temperature = 1.0, top_p = 0.95.
  2. † DSBench-FullStack is an internal full-stack development test set; DSBench-Hard is an internal test set of difficult coding-agent problems.

Chat Template

This release does not include a Jinja-format chat template. Instead, we provide a dedicated encoding folder with Python scripts and test cases demonstrating how to encode messages in OpenAI-compatible format into input strings for the model, and how to parse the model's text output. Please refer to the encoding folder for full documentation.

The reasoning_effort parameter now supports three levels — low, high, and max — which control how much deliberation the model spends before answering.

A brief example:

from encoding_dsv4 import encode_messages, parse_message_from_completion_text

messages = [
    {"role": "user", "content": "hello"},
    {"role": "assistant", "content": "Hello! I am DeepSeek.", "reasoning_content": "thinking..."},
    {"role": "user", "content": "1+1=?"}
]

# messages -> string
prompt = encode_messages(messages, thinking_mode="thinking", reasoning_effort="max")

# string -> tokens
import transformers
tokenizer = transformers.AutoTokenizer.from_pretrained("deepseek-ai/DeepSeek-V4-Pro-0813")
tokens = tokenizer.encode(prompt)

How to Run with vLLM

DSpark speculative decoding is enabled with a single flag — add --speculative-config with method: dspark to your vLLM launch command:

--speculative-config '{"method":"dspark","num_speculative_tokens":7,"draft_sample_method":"greedy"}'

For example, the command below serves the model with vLLM on a single 4×GB300 node. See the vLLM recipe for detailed instructions and other hardware configurations.

vllm serve deepseek-ai/DeepSeek-V4-Pro-0813 \
  --trust-remote-code --kv-cache-dtype fp8 --block-size 256 \
  --data-parallel-size 4 --enable-expert-parallel \
  --moe-backend deep_gemm_mega_moe \
  --attention-config '{"use_fp4_indexer_cache": true}' \
  --speculative-config '{"method":"dspark","num_speculative_tokens":7,"draft_sample_method":"greedy"}'

How to Run with SGLang

Enable DSpark with --speculative-algorithm DSPARK and do not set a separate --speculative-draft-model-path as the target and draft weights therefore come from the same checkpoint. See the SGLang cookbook for detailed instructions, benchmarks and other hardwares configurations.

sglang serve \
  --trust-remote-code \
  --model-path deepseek-ai/DeepSeek-V4-Pro-0813 \
  --tp 4 \
  --moe-runner-backend flashinfer_mxfp4 \
  --speculative-algorithm DSPARK \
  --mem-fraction-static 0.90 \
  --chunked-prefill-size 4096 \
  --swa-full-tokens-ratio 0.1 \

How to Run Locally

Please refer to the inference folder for detailed instructions on running DeepSeek-V4 locally, including model weight conversion and interactive chat demos.

For local deployment, we recommend setting the sampling parameters to temperature = 1.0, with top_p = 0.95 for agentic scenarios and top_p = 1.0 otherwise. For the high and max reasoning effort levels, we recommend a maximum output length of 384K tokens.

License

This repository and the model weights are licensed under the MIT License.

Citation

@misc{deepseekai2026deepseekv4,
      title={DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence},
      author={DeepSeek-AI},
      year={2026},
}

Contact

If you have any questions, please raise an issue or contact us at service@deepseek.com.

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms