Model reference · open weights

GLM-5.3-Flash

LLMs zai-org Text gen 7 builds Open weights 346k dl/mo

GLM-5.3-Flash is an open-weight language model from zai-org. GLM-5.3-Flash-NVFP4 (NVFP4) weighs 204 GB; the smallest configuration that runs it is 2× H200 141 GB.

What it is

Released byzai-org
Released2026-08-25
Parameters321.3B
VRAM204 GB for the weights

What it runs on

Memory and cards for GLM-5.3-Flash-NVFP4 (NVFP4)

204 GBweights, file size
35 MBcache per 1K tokens (8-bit)
3.1 GBruntime overhead, at least
1,048,576 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB … B200 180 GB
12 smaller cards
———
2× H200 141 GB
tensor parallel · FP4 without its speed-up here
8621693K138 GB a card
4× H100 80 GB
tensor parallel · FP4 without its speed-up here
5614452K78.1 GB a card
4× A100 80 GB
tensor parallel · FP4 without its speed-up here
8220660K78.2 GB a card
2× B200 180 GB
tensor parallel
20150all 1024K176 GB a card
4× RTX PRO 6000 Blackwell 96 GB
tensor parallel
11027884K93.8 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
1208 GB209 GB
5209 GB213 GB
8210 GB217 GB
16212 GB226 GB
32217 GB245 GB
64226 GB282 GB

One card, with vLLM's small-card settings.

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
GLM-5.3-Flash ↗ 321.3BFP8 328 GB4× RTX PRO 6000 Blackwell 96 GB
GLM-5.3-Flash-BF16 ↗ 321.3BBF16 643 GB8× H200 141 GB
GLM-5.3-Flash-GGUF ↗
packaged by unsloth
12 builds: IQ1_S 93.1 GB … BF16 642 GB
—GGUF 157 GB4× L40S 48 GB
GLM-5.3-Flash-NVFP4 ↗
packaged by RedHatAI
169.1BNVFP4 198 GB2× H200 141 GB
GLM-5.3-Flash-FP8 ↗
packaged by unsloth
321.3BFP8 328 GB4× RTX PRO 6000 Blackwell 96 GB
GLM-5.3-Flash ↗
packaged by unsloth
321.3BBF16 643 GB8× H200 141 GB
GLM-5.3-Flash-NVFP4 (above) ↗
packaged by nvidia
168.9BNVFP4 204 GB2× H200 141 GB

From the model card

What zai-org says about GLM-5.3-Flash

📖 Check out the GLM-5.3-Flash blog and GLM-5 Technical report. 📍 Use GLM-5.3-Flash API services on Z.ai API Platform.

Read the full model card

Introduction

We introduce GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series. With 320B total parameters and just 18B active parameters, it outperforms GLM-5.2 across benchmarks and real-world workloads at one-tenth the price, while approaching Claude Opus 4.8 on coding and agentic benchmarks.

GLM-5.3-Flash starts from a newly trained base model, with its architecture and training recipe redesigned around capability and efficiency. For the first time in the GLM series, we introduce a hybrid architecture combining sparse and linear attention, sharply reducing long-context serving costs while preserving precise long-context capabilities. The model also adopts Manifold-Constrained Hyper-Connections (mHC) to further improve scaling efficiency. Together with our latest 30T-token multimodal pre-training corpus, these changes enable GLM-5.3-Flash to deliver more intelligence with less compute.

Serve GLM-5.3-Flash Locally

GLM-5.3-Flash supports deployment with the following frameworks. Feel free to try them out:

Note

  • GLM-5.3-Flash supports controlling the thinking budget through the reasoning_effort parameter, which accepts three levels: low, high, and max. It defaults to max if not passed (or if set to any other value). To use low or high, pass them explicitly. For benchmark and leaderboard reproduction, keep the default max.
  • In the chat template for GLM-5.3-Flash, clear_thinking defaults to false if not passed. For chat scenarios, explicitly pass clear_thinking=true.

Footnotes

  • HLE w/ tools (full set): We use sampling parameters of temperature=1.0 and top_p=0.95 for evaluation, with a maximum generation length of 163,840 tokens. The evaluation is conducted with a maximum context length of 300,000 tokens, using a context management strategy. We use GPT-5.6-luna (medium) as the judge model.
  • NL2Repo: We evaluated NL2Repo with temperature=1.0, top_p=1.0, and max_new_tokens=64k under 1M context. To prevent hacking, we use rule-based and a LLM-based judgement to prevent malicious behaviors (e.g., unauthorized pip or curl operations).
  • DeepSWE: We run DeepSWE using the mini-swe-agent harness with temperature=0.95, top_p=1.0, timeout=6h and 400K context.
  • Terminal-Bench 2.1: We evaluate in Claude Code 2.1.207 with temperature=1.0, top_p=1, max_new_tokens=65536 with 6h timeout.
  • Agent’s Last Exam:
  • Toolathlon Verified: We obtain all results via the official evaluation service and report pass@1 averaged over 3 independent runs.
  • AutomationBench: We evaluate on AutomationBench v1.0.6, incorporating the fix for the null-type handling issue introduced in PR #13.
  • GDPval-AA v2: Models are evaluated by Artificial Analysis.
  • BabyVision: We use temperature=1.0, top_p=0.95, and a maximum context length of 164K tokens. We resize the input images such that their shorter side is at least 1.5K pixels, consistent with other baselines.

Citation

If you find GLM-5.3-Flash useful in your research, please cite our technical report:

@misc{glm5team2026glm5vibecodingagentic,
      title={GLM-5: from Vibe Coding to Agentic Engineering},
      author={GLM-5-Team and : and Aohan Zeng and Xin Lv and Zhenyu Hou and Zhengxiao Du and Qinkai Zheng and Bin Chen and Da Yin and Chendi Ge and Chenghua Huang and Chengxing Xie and Chenzheng Zhu and Congfeng Yin and Cunxiang Wang and Gengzheng Pan and Hao Zeng and Haoke Zhang and Haoran Wang and Huilong Chen and Jiajie Zhang and Jian Jiao and Jiaqi Guo and Jingsen Wang and Jingzhao Du and Jinzhu Wu and Kedong Wang and Lei Li and Lin Fan and Lucen Zhong and Mingdao Liu and Mingming Zhao and Pengfan Du and Qian Dong and Rui Lu and Shuang-Li and Shulin Cao and Song Liu and Ting Jiang and Xiaodong Chen and Xiaohan Zhang and Xuancheng Huang and Xuezhen Dong and Yabo Xu and Yao Wei and Yifan An and Yilin Niu and Yitong Zhu and Yuanhao Wen and Yukuo Cen and Yushi Bai and Zhongpei Qiao and Zihan Wang and Zikang Wang and Zilin Zhu and Ziqiang Liu and Zixuan Li and Bojie Wang and Bosi Wen and Can Huang and Changpeng Cai and Chao Yu and Chen Li and Chengwei Hu and Chenhui Zhang and Dan Zhang and Daoyan Lin and Dayong Yang and Di Wang and Ding Ai and Erle Zhu and Fangzhou Yi and Feiyu Chen and Guohong Wen and Hailong Sun and Haisha Zhao and Haiyi Hu and Hanchen Zhang and Hanrui Liu and Hanyu Zhang and Hao Peng and Hao Tai and Haobo Zhang and He Liu and Hongwei Wang and Hongxi Yan and Hongyu Ge and Huan Liu and Huanpeng Chu and Jia'ni Zhao and Jiachen Wang and Jiajing Zhao and Jiamin Ren and Jiapeng Wang and Jiaxin Zhang and Jiayi Gui and Jiayue Zhao and Jijie Li and Jing An and Jing Li and Jingwei Yuan and Jinhua Du and Jinxin Liu and Junkai Zhi and Junwen Duan and Kaiyue Zhou and Kangjian Wei and Ke Wang and Keyun Luo and Laiqiang Zhang and Leigang Sha and Liang Xu and Lindong Wu and Lintao Ding and Lu Chen and Mingh

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms