Model reference · open weights
SmolLM3-GSM8K-SFT is an open-weight language model from HuggingFaceTB, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
SmolLM3-3B-GSM8K-SFT Fine-tuned version of HuggingFaceTB/SmolLM3-3B-Base optimized for grade school math (GSM8K benchmark). Performance Quick Start Expected output: Using with vLLM (Recommended for Speed) Training Details Chat Template This model uses the ChatML format: Training History We tried multiple approaches to improve math reasoning: Key finding: More diverse training data (100k vs 50k samples) was more effective than more epochs or GRPO reinforcement learning. Reproduction Training and evaluation scripts are available in the training/ folder: Limitations - Optimized specifically for grade school math; may not generalize to advanced mathematics - Best performance with step-by-step reasoning format ending with #### answer - Context window limited to 2048 tokens during training Citation License Apache 2.0
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | HuggingFaceTB |
|---|---|
| Type | Language models |
| Parameters (lead) | 3.1B |
| Context | 64k tokens |
| Variants | 1 |
| Based on | HuggingFaceTB/SmolLM3-3B-Base |
| Released | 2026-04-03 |
| Popularity | 317 downloads / month |
| Likes | 2 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| SmolLM3-3B-GSM8K-SFT | 3.1B | BF16 | ~7.1 GB | ✓ | Weights ↗ |
Benchmarks
As published on the model card — the maker's own numbers, not measured by AxForge.
| Task | Dataset | Metric | Score |
|---|---|---|---|
| Math Reasoning | GSM8K | GSM8K Accuracy | 65.8 |
Using it via the API
Once AxForge deploys smollm3-gsm8k-sft for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (smollm3-gsm8k-sft below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"smollm3-gsm8k-sft","messages":[{"role":"user","content":"Hello"}]}'
Details
Languages
Trained / evaluated on
Tags
Licence
Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗