Model reference · open weights
GLM-4.6 is an open-weight language model from zai-org. GLM-4.6 (BF16) weighs 714 GB; the smallest configuration that runs it is 8× H200 141 GB.
Summary of the zai-org/GLM-4.6 model card, 2026-10-01
What it is
| Released by | zai-org |
|---|---|
| Released | 2025-09-29 |
| Parameters | 356.8B |
| VRAM | 714 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB … 8× A100 80 GB 14 smaller cards | — | — | — | |
| 8× H200 141 GB tensor parallel | 101 | 25 | all 198K | 138 GB a card |
| 8× B200 180 GB tensor parallel | 186 | 46 | all 198K | 176 GB a card |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 719 GB | 728 GB |
| 5 | 731 GB | 777 GB |
| 8 | 740 GB | 814 GB |
| 16 | 765 GB | 913 GB |
| 32 | 814 GB | 1111 GB |
| 64 | 913 GB | 1506 GB |
One card, with vLLM's small-card settings.
Builds
| Build | Params | Precision | Weights | Smallest setup |
|---|---|---|---|---|
| GLM-4.6 (above) ↗ | 356.8B | BF16 | 714 GB | 8× H200 141 GB |
| GLM-4.6-FP8 ↗ | 358.5B | FP8 | 361 GB | 4× H200 141 GB |
From the model card
📖 Check out the GLM-4.6 technical blog, technical report(GLM-4.5), and Zhipu AI technical documentation. 📍 Use GLM-4.6 API services on Z.ai API Platform. 👉 One click to GLM-4.6.
Compared with GLM-4.5, GLM-4.6 brings several key improvements:
We evaluated GLM-4.6 across eight public benchmarks covering agents, reasoning, and coding. Results show clear gains over GLM-4.5, with GLM-4.6 also holding competitive advantages over leading domestic and international models such as DeepSeek-V3.1-Terminus and Claude Sonnet 4.
Both GLM-4.5 and GLM-4.6 use the same inference method.
you can check our github for more detail.
For general evaluations, we recommend using a sampling temperature of 1.0.
For code-related evaluation tasks (such as LCB), it is further recommended to set:
top_p = 0.95top_k = 40Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.