Model reference · open weights

Hermes-4.3

LLMs NousResearch Text gen 2 builds Open weights 9k dl/mo

Hermes-4.3 is an open-weight language model from NousResearch. Hermes-4.3-36B (BF16) weighs 72.3 GB; the smallest configuration that runs it is A100 80 GB.

  • Hermes-4.3 is a 36B parameter text-generation model developed by NousResearch, based on the ByteDance Seed 36B base.
  • It features a hybrid reasoning mode that allows for explicit deliberation and supports function calling within a single assistant turn.
  • The model is trained on a post-training corpus of approximately 5 million samples and 60 billion tokens, and it is released under the Apache-2.0 license for English language tasks.

Summary of the NousResearch/Hermes-4.3-36B-GGUF model card, 2026-10-01. The estimate below is for another build of the family.

What it is

Released byNousResearch
Released2025-11-25
VRAM72.3 GB for the weights

What it runs on

Memory and cards for Hermes-4.3-36B (BF16)

72.3 GBweights, file size
262 MBcache per 1K tokens
899 MBruntime overhead, at least
524,288 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB … L40S 48 GB
6 smaller cards
———
A100 80 GB2—18K78.2 GB
H100 80 GB——42478.1 GB
RTX PRO 6000 Blackwell 96 GB7158K93.8 GB
DGX Spark (GB10) 128 GB unified133109K107 GB
H200 141 GB276223K138 GB
B200 180 GB4511361K176 GB
4× RTX 4090 24 GB
tensor parallel
8265K23.4 GB a card
4× RTX 3090 24 GB
tensor parallel
8265K23.4 GB a card
4× RTX 5090 32 GB
tensor parallel
225179K31.0 GB a card
2× H100 80 GB
tensor parallel
338270K78.1 GB a card
2× A100 80 GB
tensor parallel
389306K78.2 GB a card
4× L40S 48 GB
tensor parallel
4611372K44.0 GB a card
2× RTX PRO 6000 Blackwell 96 GB
tensor parallel
4812387K93.8 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
175.3 GB81.8 GB
583.9 GB116 GB
890.4 GB142 GB
16108 GB211 GB
32142 GB348 GB
64211 GB623 GB

One card, with vLLM's small-card settings.

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
Hermes-4.3-36B-GGUF ↗
6 builds: Q3_K_M 17.6 GB … GGUF 72.3 GB
—GGUF 21.8 GB2× RTX 3060 12 GB
Hermes-4.3-36B (above) ↗ 36.2BBF16 72.3 GBA100 80 GB

From the model card

What NousResearch says about Hermes-4.3

Read the model card

Model Description

Hermes 4.3 36B is a frontier, hybrid-mode reasoning model based on ByteDance Seed 36B base, made by Nous Research that is aligned to you.

This is our first Hermes model trained in a decentralized manner over the internet using Psyche, read the blog post: https://nousresearch.com/introducing-hermes-4-3/

Read the Hermes 4 technical report here: Hermes 4 Technical Report

Chat with Hermes in Nous Chat: https://chat.nousresearch.com

Training highlights include a newly synthesized post-training corpus emphasizing verified reasoning traces, massive improvements in math, code, STEM, logic, creativity, and format-faithful outputs, while preserving general assistant quality and broadly neutral alignment.

What’s new vs Hermes 3

  • Post-training corpus: Massively increased dataset size from 1M samples and 1.2B tokens to ~5M samples / ~60B tokens blended across reasoning and non-reasoning data.
  • Hybrid reasoning mode with explicit … segments when the model decides to deliberate, and options to make your responses faster when you want.
  • Reasoning that is top quality, expressive, improves math, code, STEM, logic, and even creative writing and subjective responses.
  • Schema adherence & structured outputs: trained to produce valid JSON for given schemas and to repair malformed objects.
  • Much easier to steer and align: extreme improvements on steerability, especially on reduced refusal rates.

Our Mission: Frontier Capabilities Aligned to You

In pursuit of the mission of producing models that are open, steerable and capable of producing the full range of human expression, while being able to be aligned to your values, we created a new benchmark, RefusalBench, that tests the models willingness to be helpful in a variety of scenarios commonly disallowed by closed and open models.

Hermes 4.3 36B is now SOTA across non-abliterated models on the RefusalBench Leaderboard, surpassing our previous best of 59.5% on Hermes 4 70B

% of Questions Answered – RefusalBench

(Average of 5 trials)

Model% of Questions Answered
Hermes 4.3 36B Non-Reasoning74.60%
Hermes 4.3 36B Reasoning72.29%
Hermes 4 70B Reasoning59.50%
Hermes 4 405B Reasoning57.10%
grok451.30%
Hermes 4 70B49.07%
Hermes 4 405B43.20%
Qwen2.5 7B36.10%
Qwen3 235B Reasoning34.30%
DeepSeek V328.10%
Gemini 2.5 Pro24.23%
Llama 405B21.70%
Gemini 2.5 Flash19.13%
GPT4o17.67%
Sonnet 417.00%
GPT4-mini16.76%
R116.70%
cogito-v2-405B Reasoning15.40%
Opus 4.115.38%
Qwen3 235B15.30%
cogito-v2-405B14.94%
cogito-v2-405B12.10%
GPT 511.34%
gpt-oss 120B5.60%
gpt-oss 20B4.79%

Hermes 4 achieves SOTA on RefusalBench across all popular closed and open models in being helpful and conforming to your values, without censorship.

Benchmarks (Hermes 4.3 36B)

Hermes 4.3 36B PsycheHermes 4.3 36B CentralizedHermes 4 70B Centralized
AIME 2471.970.673.5
AIME 2569.366.867.4
BBH86.484.787.8
DROP83.581.685.0
GPQA Diamond65.564.866.1
IFEval77.973.978.7
MATH-50093.892.395.5
MMLU87.786.588.4
MMLU-Pro80.779.780.7
MuSR69.764.770.4
OBQA96.691.894.8
SimpleQA6.05.617.9

Prompt Format

Hermes 4 uses Llama-3-Chat format with role headers and special tags.

Basic chat:


You are Hermes 4. Be concise and helpful.

Explain the photoelectric effect simply.

Reasoning mode

Reasoning mode can be activated with the chat template via the flag thinking=True or by using the following system prompt:

You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside   tags, and then provide your solution or response to the problem.

Note that you can add any additional system instructions before or after this system message, and it will adjust the models policies, style, and effort of thinking, as well as its post-thinking style, format, identity, and more. You may also interleave the tool definition system message with the reasoning one.

When the model chooses to deliberate, it emits:

…model’s internal reasoning may appear here…
Final response starts here…

Additionally, we provide a flag to keep the content inbetween the ... that you can play with by setting keep_cots=True

Function Calling & Tool Use

Hermes 4 supports function/tool calls within a single assistant turn, produced after it's reasoning:

System message (example):

You are a function-calling AI. Tools are provided inside ….
When appropriate, call a tool by emitting a {...} object.
After a tool responds (as ), continue reasoning inside  and produce the final answer.
{"type":"function","function":{"name":"get_weather","description":"Get weather by city","parameters":{"type":"object","properties":{"city":{"type":"string"}},"required":["city"]}}}

Note that you may also simply place tool definitions into the "tools:" field of your messages, and the chat template will parse and create the system prompt for you. This also works with reasoning mode for improved accuracy of tool use.

The model will then generate tool calls within {tool_call} tags, for easy parsing. The tool_call tags are also added tokens, so it makes it easy to parse while streaming! There are also automatic tool parsers built-in to VLLM and SGLang for Hermes, just set the tool parser in VLLM to hermes and in SGLang to qwen25.

Inference Notes

  • Sampling defaults that work well: `temperature=0

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

How it works

How language models work

Your prompttext / messagesTransformerattention over tokensNext-token loopgenerate + streamResponsetext · tool callsA language model reads your tokens and predicts the next one, again and again, streaming the reply back.
© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms