Model reference · open weights
deepseek-math is an open-weight language model from DeepSeek. deepseek-math-7b-base (BF16) weighs 13.8 GB; the smallest configuration that runs it is 2× RTX 3060 12 GB.
Summary of the deepseek-ai/deepseek-math-7b-base model card, 2026-10-01
What it is
| Released by | DeepSeek |
|---|---|
| Released | 2024-02-05 |
| VRAM | 13.8 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory |
|---|---|---|---|
| 4K each | |||
| RTX 3060 12 GB | — | — | 11.6 GB |
| RTX 4060 Ti 16 GB | — | 1K | 15.4 GB |
| RTX 3090 24 GB | 4 | all 4K | 23.4 GB |
| RTX 4090 24 GB | 4 | all 4K | 23.4 GB |
| RTX 5090 32 GB | 8 | all 4K | 31.0 GB |
| L40S 48 GB | 14 | all 4K | 44.0 GB |
| A100 80 GB | 31 | all 4K | 78.2 GB |
| H100 80 GB | 29 | all 4K | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | 37 | all 4K | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | 44 | all 4K | 107 GB |
| H200 141 GB | 59 | all 4K | 138 GB |
| B200 180 GB | 78 | all 4K | 176 GB |
| 2× RTX 3060 12 GB tensor parallel | 3 | all 4K | 11.6 GB a card |
| 2× RTX 4060 Ti 16 GB tensor parallel | 7 | all 4K | 15.4 GB a card |
| 2× RTX 4090 24 GB tensor parallel | 15 | all 4K | 23.4 GB a card |
| 2× RTX 3090 24 GB tensor parallel | 15 | all 4K | 23.4 GB a card |
| Requests at once | 4K tokens each |
|---|---|
| 1 | 16.5 GB |
| 5 | 24.6 GB |
| 8 | 30.6 GB |
| 16 | 46.7 GB |
| 32 | 78.9 GB |
| 64 | 143 GB |
One card, with vLLM's small-card settings.
From the model card
See the Introduction for more details.
Here give some examples of how to use our model.
Text Completion
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM, GenerationConfig
model_name = "deepseek-ai/deepseek-math-7b-base"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype=torch.bfloat16, device_map="auto")
model.generation_config = GenerationConfig.from_pretrained(model_name)
model.generation_config.pad_token_id = model.generation_config.eos_token_id
text = "The integral of x^2 from 0 to 2 is"
inputs = tokenizer(text, return_tensors="pt")
outputs = model.generate(**inputs.to(model.device), max_new_tokens=100)
result = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(result)
This code repository is licensed under the MIT License. The use of DeepSeekMath models is subject to the Model License. DeepSeekMath supports commercial use.
See the LICENSE-MODEL for more details.
If you have any questions, please raise an issue or contact us at service@deepseek.com.
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.