Model reference · open weights
k2-merged-3.5T is an open-weight language model from NousResearch. k2-merged-3.5T-fp8 (FP8) weighs 3472 GB; it needs more than the reference configurations below.
What it is
| Released by | NousResearch |
|---|---|
| Released | 2025-09-12 |
| Parameters | 3468.1B |
| VRAM | 3472 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB … 8× B200 180 GB 16 smaller cards | — | — | — | |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 3477 GB | 3480 GB |
| 5 | 3481 GB | 3496 GB |
| 8 | 3484 GB | 3507 GB |
| 16 | 3492 GB | 3538 GB |
| 32 | 3507 GB | 3601 GB |
| 64 | 3538 GB | 3725 GB |
One card, with vLLM's small-card settings.
Builds
| Build | Params | Precision | Weights | Smallest setup |
|---|---|---|---|---|
| k2-merged-3.5T-bf16 ↗ | 3468.1B | BF16 | 6936 GB | none of the reference configurations |
| k2-merged-3.5T-fp8 (above) ↗ | — | FP8 | 3472 GB | none of the reference configurations |
From the model card
Experimental frankenmerge of Kimi K2-07, 09 and Base
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.