Model reference · open weights

deepseek-math

LLMs deepseek-ai Text gen 1 build Its own licence terms 6k dl/mo

deepseek-math is an open-weight language model from DeepSeek. deepseek-math-7b-base (BF16) weighs 13.8 GB; the smallest configuration that runs it is 2× RTX 3060 12 GB.

  • DeepSeekMath is a 7-billion parameter text-generation model developed by DeepSeek.
  • It is designed for mathematical tasks, as demonstrated by its ability to solve integrals.
  • The model supports a context length of 4096 tokens and is available under a custom model license that permits commercial use.

Summary of the deepseek-ai/deepseek-math-7b-base model card, 2026-10-01

What it is

Released byDeepSeek
Released2024-02-05
VRAM13.8 GB for the weights

What it runs on

Memory and cards for deepseek-math-7b-base (BF16)

13.8 GBweights, file size
492 MBcache per 1K tokens
692 MBruntime overhead, at least
4,096 tokenscontext max
CardRequests at onceContext maxMemory
4K each
RTX 3060 12 GB——11.6 GB
RTX 4060 Ti 16 GB—1K15.4 GB
RTX 3090 24 GB4all 4K23.4 GB
RTX 4090 24 GB4all 4K23.4 GB
RTX 5090 32 GB8all 4K31.0 GB
L40S 48 GB14all 4K44.0 GB
A100 80 GB31all 4K78.2 GB
H100 80 GB29all 4K78.1 GB
RTX PRO 6000 Blackwell 96 GB37all 4K93.8 GB
DGX Spark (GB10) 128 GB unified44all 4K107 GB
H200 141 GB59all 4K138 GB
B200 180 GB78all 4K176 GB
2× RTX 3060 12 GB
tensor parallel
3all 4K11.6 GB a card
2× RTX 4060 Ti 16 GB
tensor parallel
7all 4K15.4 GB a card
2× RTX 4090 24 GB
tensor parallel
15all 4K23.4 GB a card
2× RTX 3090 24 GB
tensor parallel
15all 4K23.4 GB a card
Memory needed at each load
Requests at once4K tokens each
116.5 GB
524.6 GB
830.6 GB
1646.7 GB
3278.9 GB
64143 GB

One card, with vLLM's small-card settings.

From the model card

What DeepSeek says about deepseek-math

Read the model card

1. Introduction to DeepSeekMath

See the Introduction for more details.

2. How to Use

Here give some examples of how to use our model.

Text Completion

import torch
from transformers import AutoTokenizer, AutoModelForCausalLM, GenerationConfig

model_name = "deepseek-ai/deepseek-math-7b-base"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype=torch.bfloat16, device_map="auto")
model.generation_config = GenerationConfig.from_pretrained(model_name)
model.generation_config.pad_token_id = model.generation_config.eos_token_id

text = "The integral of x^2 from 0 to 2 is"
inputs = tokenizer(text, return_tensors="pt")
outputs = model.generate(**inputs.to(model.device), max_new_tokens=100)

result = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(result)

3. License

This code repository is licensed under the MIT License. The use of DeepSeekMath models is subject to the Model License. DeepSeekMath supports commercial use.

See the LICENSE-MODEL for more details.

4. Contact

If you have any questions, please raise an issue or contact us at service@deepseek.com.

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms