Model reference · open weights

Hermes-4.3

LLMs NousResearch Text gen 2 builds Open weights 9k dl/mo

Hermes-4.3 is an open-weight language model from NousResearch. Hermes-4.3-36B-GGUF (GGUF) weighs 21.8 GB; the smallest configuration that runs it is 2× RTX 3060 12 GB.

  • Hermes-4.3 is a 36B parameter text-generation model developed by NousResearch, based on the ByteDance Seed 36B base.
  • It features a hybrid reasoning mode that allows for explicit deliberation and supports function calling within a single assistant turn.
  • The model is trained on a post-training corpus of approximately 5 million samples and 60 billion tokens, and it is released under the Apache-2.0 license for English language tasks.

Summary of the NousResearch/Hermes-4.3-36B-GGUF model card, 2026-10-01

What it is

Released byNousResearch
Released2025-11-25
VRAM21.8 GB for the weights

What it runs on

Memory and cards for Hermes-4.3-36B-GGUF (GGUF)

21.8 GBweights, file size
651 MBruntime overhead, at least

How much memory each request adds isn't estimated yet for this architecture. The weights need at least the cards below, plus room for the context.

CardWeights alone
RTX 3060 12 GB … RTX 4060 Ti 16 GB
2 smaller cards
does not fit
RTX 3090 24 GBtight
RTX 4090 24 GBtight
RTX 5090 32 GBfits
L40S 48 GBfits
A100 80 GBfits
H100 80 GBfits
RTX PRO 6000 Blackwell 96 GBfits
DGX Spark (GB10) 128 GB unifiedfits
H200 141 GBfits
B200 180 GBfits
2× RTX 3060 12 GB
split by layers (llama.cpp)
tight
2× RTX 4060 Ti 16 GB
split by layers (llama.cpp)
fits
2× RTX 4090 24 GB
split by layers (llama.cpp)
fits
2× RTX 3090 24 GB
split by layers (llama.cpp)
fits

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
Hermes-4.3-36B-GGUF (above) ↗
6 builds: Q3_K_M 17.6 GB … GGUF 72.3 GB
—GGUF 21.8 GB2× RTX 3060 12 GB
Hermes-4.3-36B ↗ 36.2BBF16 72.3 GBA100 80 GB

From the model card

What NousResearch says about Hermes-4.3

Read the model card

Model Description

Hermes 4.3 36B is a frontier, hybrid-mode reasoning model based on ByteDance Seed 36B base, made by Nous Research that is aligned to you.

This is our first Hermes model trained in a decentralized manner over the internet using Psyche, read the blog post: https://nousresearch.com/introducing-hermes-4-3/

Read the Hermes 4 technical report here: Hermes 4 Technical Report

Chat with Hermes in Nous Chat: https://chat.nousresearch.com

Training highlights include a newly synthesized post-training corpus emphasizing verified reasoning traces, massive improvements in math, code, STEM, logic, creativity, and format-faithful outputs, while preserving general assistant quality and broadly neutral alignment.

What’s new vs Hermes 3

  • Post-training corpus: Massively increased dataset size from 1M samples and 1.2B tokens to ~5M samples / ~60B tokens blended across reasoning and non-reasoning data.
  • Hybrid reasoning mode with explicit … segments when the model decides to deliberate, and options to make your responses faster when you want.
  • Reasoning that is top quality, expressive, improves math, code, STEM, logic, and even creative writing and subjective responses.
  • Schema adherence & structured outputs: trained to produce valid JSON for given schemas and to repair malformed objects.
  • Much easier to steer and align: extreme improvements on steerability, especially on reduced refusal rates.

Our Mission: Frontier Capabilities Aligned to You

In pursuit of the mission of producing models that are open, steerable and capable of producing the full range of human expression, while being able to be aligned to your values, we created a new benchmark, RefusalBench, that tests the models willingness to be helpful in a variety of scenarios commonly disallowed by closed and open models.

Hermes 4.3 36B is now SOTA across non-abliterated models on the RefusalBench Leaderboard, surpassing our previous best of 59.5% on Hermes 4 70B

% of Questions Answered – RefusalBench

(Average of 5 trials)

Model% of Questions Answered
Hermes 4.3 36B Non-Reasoning74.60%
Hermes 4.3 36B Reasoning72.29%
Hermes 4 70B Reasoning59.50%
Hermes 4 405B Reasoning57.10%
grok451.30%
Hermes 4 70B49.07%
Hermes 4 405B43.20%
Qwen2.5 7B36.10%
Qwen3 235B Reasoning34.30%
DeepSeek V328.10%
Gemini 2.5 Pro24.23%
Llama 405B21.70%
Gemini 2.5 Flash19.13%
GPT4o17.67%
Sonnet 417.00%
GPT4-mini16.76%
R116.70%
cogito-v2-405B Reasoning15.40%
Opus 4.115.38%
Qwen3 235B15.30%
cogito-v2-405B14.94%
cogito-v2-405B12.10%
GPT 511.34%
gpt-oss 120B5.60%
gpt-oss 20B4.79%

Hermes 4 achieves SOTA on RefusalBench across all popular closed and open models in being helpful and conforming to your values, without censorship.

Benchmarks (Hermes 4.3 36B)

Hermes 4.3 36B PsycheHermes 4.3 36B CentralizedHermes 4 70B Centralized
AIME 2471.970.673.5
AIME 2569.366.867.4
BBH86.484.787.8
DROP83.581.685.0
GPQA Diamond65.564.866.1
IFEval77.973.978.7
MATH-50093.892.395.5
MMLU87.786.588.4
MMLU-Pro80.779.780.7
MuSR69.764.770.4
OBQA96.691.894.8
SimpleQA6.05.617.9

Prompt Format

Hermes 4 uses Llama-3-Chat format with role headers and special tags.

Basic chat:


You are Hermes 4. Be concise and helpful.

Explain the photoelectric effect simply.

Reasoning mode

Reasoning mode can be activated with the chat template via the flag thinking=True or by using the following system prompt:

You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside   tags, and then provide your solution or response to the problem.

Note that you can add any additional system instructions before or after this system message, and it will adjust the models policies, style, and effort of thinking, as well as its post-thinking style, format, identity, and more. You may also interleave the tool definition system message with the reasoning one.

When the model chooses to deliberate, it emits:

…model’s internal reasoning may appear here…
Final response starts here…

Additionally, we provide a flag to keep the content inbetween the ... that you can play with by setting keep_cots=True

Function Calling & Tool Use

Hermes 4 supports function/tool calls within a single assistant turn, produced after it's reasoning:

System message (example):

You are a function-calling AI. Tools are provided inside ….
When appropriate, call a tool by emitting a {...} object.
After a tool responds (as ), continue reasoning inside  and produce the final answer.
{"type":"function","function":{"name":"get_weather","description":"Get weather by city","parameters":{"type":"object","properties":{"city":{"type":"string"}},"required":["city"]}}}

Note that you may also simply place tool definitions into the "tools:" field of your messages, and the chat template will parse and create the system prompt for you. This also works with reasoning mode for improved accuracy of tool use.

The model will then generate tool calls within {tool_call} tags, for easy parsing. The tool_call tags are also added tokens, so it makes it easy to parse while streaming! There are also automatic tool parsers built-in to VLLM and SGLang for Hermes, just set the tool parser in VLLM to hermes and in SGLang to qwen25.

Inference Notes

  • Sampling defaults that work well: `temperature=0

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

How it works

How language models work

Your prompttext / messagesTransformerattention over tokensNext-token loopgenerate + streamResponsetext · tool callsA language model reads your tokens and predicts the next one, again and again, streaming the reply back.
© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms