Model reference · open weights

GLM-4.6

LLMs zai-org Text gen 2 builds Open weights 17k dl/mo

GLM-4.6 is an open-weight language model from zai-org. GLM-4.6 (BF16) weighs 714 GB; the smallest configuration that runs it is 8× H200 141 GB.

  • GLM-4.6 is a text-generation model developed by zai-org with 356.8B parameters.
  • It supports a context length of 202,752 tokens and operates in English and Chinese.
  • The model is released under the MIT license.

Summary of the zai-org/GLM-4.6 model card, 2026-10-01

What it is

Released byzai-org
Released2025-09-29
Parameters356.8B
VRAM714 GB for the weights

What it runs on

Memory and cards for GLM-4.6 (BF16)

714 GBweights, file size
377 MBcache per 1K tokens
1.9 GBruntime overhead, at least
202,752 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB … 8× A100 80 GB
14 smaller cards
———
8× H200 141 GB
tensor parallel
10125all 198K138 GB a card
8× B200 180 GB
tensor parallel
18646all 198K176 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
1719 GB728 GB
5731 GB777 GB
8740 GB814 GB
16765 GB913 GB
32814 GB1111 GB
64913 GB1506 GB

One card, with vLLM's small-card settings.

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
GLM-4.6 (above) ↗ 356.8BBF16 714 GB8× H200 141 GB
GLM-4.6-FP8 ↗ 358.5BFP8 361 GB4× H200 141 GB

From the model card

What zai-org says about GLM-4.6

Read the model card

📖 Check out the GLM-4.6 technical blog, technical report(GLM-4.5), and Zhipu AI technical documentation. 📍 Use GLM-4.6 API services on Z.ai API Platform. 👉 One click to GLM-4.6.

Model Introduction

Compared with GLM-4.5, GLM-4.6 brings several key improvements:

  • Longer context window: The context window has been expanded from 128K to 200K tokens, enabling the model to handle more complex agentic tasks.
  • Superior coding performance: The model achieves higher scores on code benchmarks and demonstrates better real-world performance in applications such as Claude Code、Cline、Roo Code and Kilo Code, including improvements in generating visually polished front-end pages.
  • Advanced reasoning: GLM-4.6 shows a clear improvement in reasoning performance and supports tool use during inference, leading to stronger overall capability.
  • More capable agents: GLM-4.6 exhibits stronger performance in tool using and search-based agents, and integrates more effectively within agent frameworks.
  • Refined writing: Better aligns with human preferences in style and readability, and performs more naturally in role-playing scenarios.

We evaluated GLM-4.6 across eight public benchmarks covering agents, reasoning, and coding. Results show clear gains over GLM-4.5, with GLM-4.6 also holding competitive advantages over leading domestic and international models such as DeepSeek-V3.1-Terminus and Claude Sonnet 4.

Inference

Both GLM-4.5 and GLM-4.6 use the same inference method.

you can check our github for more detail.

Recommended Evaluation Parameters

For general evaluations, we recommend using a sampling temperature of 1.0.

For code-related evaluation tasks (such as LCB), it is further recommended to set:

  • top_p = 0.95
  • top_k = 40

Evaluation

  • For tool-integrated reasoning, please refer to this doc.
  • For search benchmark, we design a specific format for searching toolcall in thinking mode to support search agent, please refer to this. for the detailed template.

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms