Model reference · open weights

Hy3

LLMs tencent Text gen 2 builds Its own licence terms 60k dl/mo

Hy3 is an open-weight language model from tencent. Hy3-FP8 (FP8) weighs 300 GB; the smallest configuration that runs it is 2× B200 180 GB.

  • Hy3 is a 295B-parameter Mixture-of-Experts text-generation model developed by Tencent, featuring 21B active parameters and a 256K context length.
  • It is designed for complex reasoning, instruction following, coding, and agent tasks, and is released under the Tencent Hy Community License Agreement.

Summary of the tencent/Hy3-preview model card, 2026-10-01. The estimate below is for another build of the family.

What it is

Released bytencent
Released2026-04-13
Parameters298.8B
VRAM300 GB for the weights

What it runs on

Memory and cards for Hy3-FP8 (FP8)

300 GBweights, file size
164 MBcache per 1K tokens (8-bit)
1.7 GBruntime overhead, at least
262,144 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB … B200 180 GB
12 smaller cards
———
2× B200 180 GB
tensor parallel
194159K176 GB a card
4× RTX PRO 6000 Blackwell 96 GB
tensor parallel
307247K93.8 GB a card
4× H200 141 GB
tensor parallel
16240all 256K138 GB a card
8× H100 80 GB
tensor parallel
19147all 256K78.1 GB a card
8× A100 80 GB
tensor parallel · FP8 without its speed-up here
23258all 256K78.2 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
1303 GB307 GB
5308 GB328 GB
8312 GB345 GB
16323 GB387 GB
32345 GB473 GB
64387 GB645 GB

One card, with vLLM's small-card settings.

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
Hy3-preview ↗ 298.8BBF16 598 GB8× A100 80 GB
Hy3-FP8 (above) ↗ 298.8BFP8 300 GB2× B200 180 GB

From the model card

What tencent says about Hy3

Read the model card

           

🖥️ Official Website  |  
💬 GitHub

Table of Contents


Model Introduction

Hy3 preview is a 295B-parameter Mixture-of-Experts (MoE) model with 21B active parameters and 3.8B MTP layer parameters, developed by the Tencent Hy Team. Hy3 preview is the first model trained on our rebuilt infrastructure, and the strongest we've shipped so far. It improves significantly on complex reasoning, instruction following, context learning, coding, and agent tasks.

PropertyValue
ArchitectureMixture-of-Experts (MoE)
Total Parameters295B
Activated Parameters21B
MTP Layer Parameters3.8B
Number of Layers (excluding MTP layer)80
Number of MTP Layers1
Attention Heads64 (GQA, 8 KV heads, head dim 128)
Hidden Size4096
Intermediate Size13312
Context Length256K
Vocabulary Size120832
Number of Experts192 experts, top-8 activated
Supported PrecisionsBF16

Highlights

  • STEM & Reasoning — Complex reasoning underpins everything else. Hy3 preview performs well on challenging STEM benchmarks like FrontierScience-Olympiad and IMOAnswerBench, and achieved excellent results in the Tsinghua Qiuzhen College Math PhD qualifying exam (Spring '26) and the China High School Biology Olympiad (CHSBO 2025), demonstrating generalizable reasoning capacity.

  • Context Learning & Instruction Following — Real-world tasks require the ability to parse messy, lengthy contexts and follow complex rules. We built CL-bench and CL-bench-Life from our own business scenarios to innovatively measure context learning ability. Hy3 preview exhibits solid gains in both context learning and instruction following capabilities.

  • Code & Agent — Coding and agents saw the biggest gains. With a rebuilt RL infrastructure and larger-scale training tasks, we posted competitive scores across mainstream coding agent benchmarks (SWE-bench Verified, Terminal-Bench 2.0) and search agent benchmarks (BrowseComp, WideSearch).

Benchmark Results

Pre-trained Model Performance

CategoryBenchmark (Metric)# ShotsKimi-K2 BASEDeepSeek-V3 BASEGLM-4.5 BASEHy3 preview-Base
#ActivatedParams-32B37B32B21B
#TotalParams-1043B671B355B295B
EnglishMMLU5-shot88.2487.6887.7387.42
MMLU-Pro5-shot65.9863.9863.6765.76
MMLU-Redux5-shot87.1886.8186.5686.86
ARC-Challenge0-shot96.6694.6596.3295.99
DROP5-shot86.4086.5082.9085.50
PIQA4-shot84.9384.2284.7184.39
SuperGPQA5-shot51.1046.1749.6451.60
SimpleQA5-shot34.3726.1529.2626.47
CodeMBPP-plus3-shot81.3575.4778.0578.71
CRUXEval-I3-shot68.0167.7968.5171.19
CRUXEval-O3-shot69.6271.0067.7568.38
LiveCodeBench-v61-shot30.8629.3127.4334.86
MathGSM8K4-shot93.4688.1590.0695.37
MATH4-shot71.2059.3761.0076.28
CMath4-shot90.8385.5089.3391.17
ChineseC-Eval5-shot91.5190.3585.8489.80
CMMLU5-shot90.7287.9086.4689.61
Chinese-simpleQA5-shot74.5868.7268.4969.73
MultilingualMMMLU5-shot77.6379.5479.2680.15
INCLUDE5-shot75.6677.8676.2778.64

Instruct Model Performance

STEM & Reasoning

Complex reasoning underpins everything else. Hy3 preview performs well on challenging STEM benchmarks like FrontierScience-Olympiad and IMOAnswerBench. It also achieved excellent results in the Tsinghua Qiuzhen College Math PhD qualifying exam (Spring '26) and the China High School Biology Olympiad (CHSBO 2025), demonstrating a high degree of generalizable reasoning capacity.

Context Learning & Instruction Following

Real-world tasks require the ability to parse messy, lengthy contexts and follow complex rules. We built CL-bench and CL-bench-Life from our own business scenarios to innovatively measure context learning ability. Hy3 preview exhibits solid gains in both context learning and instruction following capabilities.

Code & Agent

Coding and agents saw the biggest gains. With a rebuilt RL infrastructure and larger-scale training tasks, we posted competitive scores across mainstream coding agent benchmarks (SWE-bench Verified, Terminal-Bench 2.0) and search agent benchmarks (BrowseComp, WideSearch).

Coding is about whether a model can execute in a development environment. Search is about whether it can find and combine information from the open web. Both matter for complex agent scenarios like OpenClaw. Hy3 preview scores well on ClawEval and WildClawBench — a sign that its agent capabilities are becoming practical.

Beyond public benchmarks, we built internal evaluation sets to test the model in real development scenarios. On Hy-Backend (backend-focused tasks), Hy-Vibe Be

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms