Model reference · open weights

GLM-4.6

LLMs zai-org Text gen 2 builds Open weights 17k dl/mo

GLM-4.6 is an open-weight language model from zai-org. GLM-4.6-FP8 (FP8) weighs 361 GB; the smallest configuration that runs it is 4× H200 141 GB.

  • GLM-4.6 is a text-generation model developed by zai-org with 356.8B parameters.
  • It supports a context length of 202,752 tokens and operates in English and Chinese.
  • The model is released under the MIT license.

Summary of the zai-org/GLM-4.6 model card, 2026-10-01. The estimate below is for another build of the family.

What it is

Released byzai-org
Released2025-09-29
Parameters356.8B
VRAM361 GB for the weights

What it runs on

Memory and cards for GLM-4.6-FP8 (FP8)

361 GBweights, file size
377 MBcache per 1K tokens
1.9 GBruntime overhead, at least
202,752 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB … B200 180 GB
12 smaller cards
———
4× H200 141 GB
tensor parallel
4912all 198K138 GB a card
8× H100 80 GB
tensor parallel
6015all 198K78.1 GB a card
8× A100 80 GB
tensor parallel · FP8 without its speed-up here
8020all 198K78.2 GB a card
4× B200 180 GB
tensor parallel
9122all 198K176 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
1366 GB376 GB
5379 GB425 GB
8388 GB462 GB
16413 GB561 GB
32462 GB758 GB
64561 GB1153 GB

One card, with vLLM's small-card settings.

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
GLM-4.6 ↗ 356.8BBF16 714 GB8× H200 141 GB
GLM-4.6-FP8 (above) ↗ 358.5BFP8 361 GB4× H200 141 GB

From the model card

What zai-org says about GLM-4.6

Read the model card

📖 Check out the GLM-4.6 technical blog, technical report(GLM-4.5), and Zhipu AI technical documentation. 📍 Use GLM-4.6 API services on Z.ai API Platform. 👉 One click to GLM-4.6.

Model Introduction

Compared with GLM-4.5, GLM-4.6 brings several key improvements:

  • Longer context window: The context window has been expanded from 128K to 200K tokens, enabling the model to handle more complex agentic tasks.
  • Superior coding performance: The model achieves higher scores on code benchmarks and demonstrates better real-world performance in applications such as Claude Code、Cline、Roo Code and Kilo Code, including improvements in generating visually polished front-end pages.
  • Advanced reasoning: GLM-4.6 shows a clear improvement in reasoning performance and supports tool use during inference, leading to stronger overall capability.
  • More capable agents: GLM-4.6 exhibits stronger performance in tool using and search-based agents, and integrates more effectively within agent frameworks.
  • Refined writing: Better aligns with human preferences in style and readability, and performs more naturally in role-playing scenarios.

We evaluated GLM-4.6 across eight public benchmarks covering agents, reasoning, and coding. Results show clear gains over GLM-4.5, with GLM-4.6 also holding competitive advantages over leading domestic and international models such as DeepSeek-V3.1-Terminus and Claude Sonnet 4.

Inference

Both GLM-4.5 and GLM-4.6 use the same inference method.

you can check our github for more detail.

Recommended Evaluation Parameters

For general evaluations, we recommend using a sampling temperature of 1.0.

For code-related evaluation tasks (such as LCB), it is further recommended to set:

  • top_p = 0.95
  • top_k = 40

Evaluation

  • For tool-integrated reasoning, please refer to this doc.
  • For search benchmark, we design a specific format for searching toolcall in thinking mode to support search agent, please refer to this. for the detailed template.

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms