Model reference · open weights

AREX

LLMs BAAI Text gen 2 builds Open weights 748 dl/mo

AREX is an open-weight language model from BAAI. AREX-Turbo (BF16) weighs 9.1 GB; the smallest configuration that runs it is RTX 3060 12 GB.

  • AREX-Turbo is a dense 4.5B parameter text-generation model developed by BAAI for long-horizon deep research tasks.
  • It supports a context length of 262,144 tokens and operates in English.
  • The model is released under the Apache 2.0 license.

Summary of the BAAI/AREX-Turbo model card, 2026-10-01

What it is

Released byBAAI
Released2026-07-23
Parameters4.5B
VRAM9.1 GB for the weights

What it runs on

Memory and cards for AREX-Turbo (BF16)

9.1 GBweights, file size
33 MBcache per 1K tokens
103 MBfixed state per request
2.1 GBruntime overhead, at least
262,144 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB1—10K11.6 GB
RTX 4060 Ti 16 GB113123K15.4 GB
RTX 3090 24 GB3210all 256K23.4 GB
RTX 4090 24 GB3210all 256K23.4 GB
RTX 5090 32 GB5316all 256K31.0 GB
L40S 48 GB8827all 256K44.0 GB
A100 80 GB18056all 256K78.2 GB
H100 80 GB16652all 256K78.1 GB
RTX PRO 6000 Blackwell 96 GB20865all 256K93.8 GB
DGX Spark (GB10) 128 GB unified24477all 256K107 GB
H200 141 GB327103all 256K138 GB
B200 180 GB428135all 256K176 GB
2× RTX 3060 12 GB
tensor parallel
268all 256K11.6 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
111.5 GB12.3 GB
513.0 GB17.1 GB
814.1 GB20.6 GB
1617.1 GB30.0 GB
3223.1 GB48.8 GB
6434.9 GB86.5 GB

One card, with vLLM's small-card settings.

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
AREX-Turbo (above) ↗ 4.5BBF16 9.1 GBRTX 3060 12 GB
AREX-Base ↗ 122.6BBF16 245 GB2× H200 141 GB

From the model card

What BAAI says about AREX

Read the model card

Introduction

AREX is a family of deep research agents developed by the Beijing Academy of Artificial Intelligence (BAAI). It is designed for long-horizon tasks in which an agent must search across sources, assemble candidate answers, verify multiple constraints, and revise its research plan when the available evidence is incomplete.

AREX follows a recursive self-improvement framework consisting of an inner research loop and an outer self-improvement loop. The inner loop conducts deep research, while the outer loop evaluates and improves the research process.

This repository contains AREX-Turbo, the compact model in the AREX family. It is a dense 4B model built on Qwen3.5-4B and follows the same recursive deep research framework as AREX-Base. AREX-Turbo targets lower-cost research-agent deployment while retaining AREX's core research, verification, and context-management behavior.

  • Architecture: Dense
  • Parameters: 4B
  • Context length: 262,144 tokens

Key Features

  • Compact research agent: provides AREX capabilities in a dense 4B model for lower-cost serving and faster iteration.
  • Recursive self-improvement: evaluates provisional answers and chooses whether to accept, refine, or restart the research trajectory.
  • Verification-guided research: converts unresolved answer constraints into focused follow-up searches.
  • Autonomous context updates: retains verified findings, source identifiers, rejected candidates, open constraints, and the next research plan.
  • Long-horizon tool use: supports multi-round search, browsing, evidence integration, and answer construction.

Model Family

ModelBackboneContextLinksPositioning
AREX-BaseQwen3.5-122B-A10B256K🤗 Hugging Face · 🤖 ModelScopeHigher-capacity model with the strongest overall AREX results.
AREX-TurboQwen3.5-4B256K🤗 Hugging Face · 🤖 ModelScopeCompact model for lower-cost research and tool-use settings.

Method

AREX organizes deep research as two interacting loops supported by autonomous context management.

  1. Inner research loop. The agent searches, reads, integrates evidence, tracks candidates, and produces a provisional answer with supporting evidence and an answer-level confidence score.
  2. Outer self-improvement loop. The agent checks the provisional answer against the original constraints. High-confidence answers are accepted. Recoverable trajectories are refined around unresolved claims, while uninformative trajectories can be restarted.
  3. Autonomous context update. The model invokes update_context to refresh its research state around verified findings, current and rejected candidates, unresolved constraints, source validity, and the next research plan.

This design preserves useful work across iterations and reduces repeated exploration of paths that have already been rejected.

Evaluation

AREX is evaluated through a unified long-horizon search-agent interface with search, visit, update_context, and finish tools. HLE with tools additionally provides a Python tool.

Inference

See inference/README.md for OpenAI-compatible serving and generation examples. The folder also contains the complete, directly formattable system and user prompts used for BrowseComp.

Intended Use

AREX-Turbo is intended for research-agent applications that require long-horizon information seeking, evidence aggregation, multi-constraint verification, and tool-augmented reasoning under a smaller model footprint. It is suited to settings where serving cost, latency, or iteration speed matter.

License

AREX-Turbo is released under the Apache License 2.0.

Citation

@misc{baai2026arex,
      title={AREX: Towards a Recursively Self-Improving Agent for Deep Research},
      author={Shuqi Lu and Chaofan Li and Kun Luo and Zhang Zhang and Hui Wang and Hongwang Xiao and Lei Xiong and Jiahao Wang and Sen Wang and Xiyan Jiang and Wanli Li and Yuyang Hu and Hongjin Qian and Bingyu Yan and Ziyi Xia and Yingxia Shao and Kang Liu and Zhicheng Dou and Di He and Chaozhuo Li and Qiwei Ye and Zhongyuan Wang and Zheng Liu},
      year={2026},
      eprint={2607.21461},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2607.21461},
}

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms