Model reference · open weights
Nous-Hermes-2-Yi is an open-weight language model from NousResearch. Nous-Hermes-2-Yi-34B (BF16) weighs 68.8 GB; the smallest configuration that runs it is H100 80 GB.
Summary of the NousResearch/Nous-Hermes-2-Yi-34B model card, 2026-10-01
What it is
| Released by | NousResearch |
|---|---|
| Released | 2023-12-23 |
| Parameters | 34.4B |
| VRAM | 68.8 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory |
|---|---|---|---|
| 4K each | |||
| RTX 3060 12 GB … L40S 48 GB 6 smaller cards | — | — | |
| A100 80 GB | 8 | all 4K | 78.2 GB |
| H100 80 GB | 4 | all 4K | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | 20 | all 4K | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | 33 | all 4K | 107 GB |
| H200 141 GB | 64 | all 4K | 138 GB |
| B200 180 GB | 101 | all 4K | 176 GB |
| 2× L40S 48 GB tensor parallel | 17 | all 4K | 44.0 GB a card |
| 4× RTX 4090 24 GB tensor parallel | 21 | all 4K | 23.4 GB a card |
| 4× RTX 3090 24 GB tensor parallel | 21 | all 4K | 23.4 GB a card |
| 4× RTX 5090 32 GB tensor parallel | 51 | all 4K | 31.0 GB a card |
| 2× H100 80 GB tensor parallel | 77 | all 4K | 78.1 GB a card |
| 2× A100 80 GB tensor parallel | 85 | all 4K | 78.2 GB a card |
| Requests at once | 4K tokens each |
|---|---|
| 1 | 70.6 GB |
| 5 | 74.6 GB |
| 8 | 77.6 GB |
| 16 | 85.7 GB |
| 32 | 102 GB |
| 64 | 134 GB |
One card, with vLLM's small-card settings.
From the model card
Nous Hermes 2 - Yi-34B is a state of the art Yi Fine-tune.
Nous Hermes 2 Yi 34B was trained on 1,000,000 entries of primarily GPT-4 generated data, as well as other high quality data from open datasets across the AI landscape.
Nous-Hermes 2 on Yi 34B outperforms all Nous-Hermes & Open-Hermes models of the past, achieving new heights in all benchmarks for a Nous Research LLM as well as surpassing many popular finetunes.
GPT-4All Benchmark Set
| Task |Version| Metric |Value | |Stderr|
|-------------|------:|--------|-----:|---|-----:|
|arc_challenge| 0|acc |0.6067|_ |0.0143|
| | |acc_norm|0.6416|_ |0.0140|
|arc_easy | 0|acc |0.8594|_ |0.0071|
| | |acc_norm|0.8569|_ |0.0072|
|boolq | 1|acc |0.8859|_ |0.0056|
|hellaswag | 0|acc |0.6407|_ |0.0048|
| | |acc_norm|0.8388|_ |0.0037|
|openbookqa | 0|acc |0.3520|_ |0.0214|
| | |acc_norm|0.4760|_ |0.0224|
|piqa | 0|acc |0.8215|_ |0.0089|
| | |acc_norm|0.8303|_ |0.0088|
|winogrande | 0|acc |0.7908|_ |0.0114|
Average: 76.00%
AGI-Eval
| Task |Version| Metric |Value | |Stderr|
|------------------------------|------:|--------|-----:|---|-----:|
|agieval_aqua_rat | 0|acc |0.3189|_ |0.0293|
| | |acc_norm|0.2953|_ |0.0287|
|agieval_logiqa_en | 0|acc |0.5438|_ |0.0195|
| | |acc_norm|0.4977|_ |0.0196|
|agieval_lsat_ar | 0|acc |0.2696|_ |0.0293|
| | |acc_norm|0.2087|_ |0.0269|
|agieval_lsat_lr | 0|acc |0.7078|_ |0.0202|
| | |acc_norm|0.6255|_ |0.0215|
|agieval_lsat_rc | 0|acc |0.7807|_ |0.0253|
| | |acc_norm|0.7063|_ |0.0278|
|agieval_sat_en | 0|acc |0.8689|_ |0.0236|
| | |acc_norm|0.8447|_ |0.0253|
|agieval_sat_en_without_passage| 0|acc |0.5194|_ |0.0349|
| | |acc_norm|0.4612|_ |0.0348|
|agieval_sat_math | 0|acc |0.4409|_ |0.0336|
| | |acc_norm|0.3818|_ |0.0328|
Average: 50.27%
BigBench Reasoning Test
| Task |Version| Metric |Value | |Stderr|
|------------------------------------------------|------:|---------------------|-----:|---|-----:|
|bigbench_causal_judgement | 0|multiple_choice_grade|0.5737|_ |0.0360|
|bigbench_date_understanding | 0|multiple_choice_grade|0.7263|_ |0.0232|
|bigbench_disambiguation_qa | 0|multiple_choice_grade|0.3953|_ |0.0305|
|bigbench_geometric_shapes | 0|multiple_choice_grade|0.4457|_ |0.0263|
| | |exact_str_match |0.0000|_ |0.0000|
|bigbench_logical_deduction_five_objects | 0|multiple_choice_grade|0.2820|_ |0.0201|
|bigbench_logical_deduction_seven_objects | 0|multiple_choice_grade|0.2186|_ |0.0156|
|bigbench_logical_deduction_three_objects | 0|multiple_choice_grade|0.4733|_ |0.0289|
|bigbench_movie_recommendation | 0|multiple_choice_grade|0.5200|_ |0.0224|
|bigbench_navigate | 0|multiple_choice_grade|0.4910|_ |0.0158|
|bigbench_reasoning_about_colored_objects | 0|multiple_choice_grade|0.7495|_ |0.0097|
|bigbench_ruin_names | 0|multiple_choice_grade|0.5938|_ |0.0232|
|bigbench_salient_translation_error_detection | 0|multiple_choice_grade|0.3808|_ |0.0154|
|bigbench_snarks | 0|multiple_choice_grade|0.8066|_ |0.0294|
|bigbench_sports_understanding | 0|multiple_choice_grade|0.5101|_ |0.0159|
|bigbench_temporal_sequences | 0|multiple_choice_grade|0.3850|_ |0.0154|
|bigbench_tracking_shuffled_objects_five_objects | 0|multiple_choice_grade|0.2160|_ |0.0116|
|bigbench_tracking_shuffled_objects_seven_objects| 0|multiple_choice_grade|0.1634|_ |0.0088|
|bigbench_tracking_shuffled_objects_three_objects| 0|multiple_choice_grade|0.4733|_ |0.0289|
Average: 46.69%
TruthfulQA:
| Task |Version|Metric|Value | |Stderr|
|-------------|------:|------|-----:|---|-----:|
|truthfulqa_mc| 1|mc1 |0.4333|_ |0.0173|
| | |mc2 |0.6034|_ |0.0149|
Average Score Comparison between OpenHermes-1 Llama-2 13B and OpenHermes-2 Mistral 7B against OpenHermes-2.5 on Mistral-7B:
| Bench | OpenHermes-2.5 Mistral 7B | Nous-Hermes-2-Yi-34B | Change/OpenHermes2 |
|---------------|---------------------------|----------------------|--------------------|
|GPT4All | 73.12| 76.00| +2.88|
|---------------------------------------------------------------------------------------|
|BigBench | 40.96| 46.69| +5.73|
|------------------------------------------------------------------------Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.