Model reference · open weights

AREX

LLMs BAAI Text gen 2 builds Open weights 748 dl/mo

AREX is an open-weight language model from BAAI. AREX-Base (BF16) weighs 245 GB; the smallest configuration that runs it is 2× H200 141 GB.

  • AREX-Turbo is a dense 4.5B parameter text-generation model developed by BAAI for long-horizon deep research tasks.
  • It supports a context length of 262,144 tokens and operates in English.
  • The model is released under the Apache 2.0 license.

Summary of the BAAI/AREX-Turbo model card, 2026-10-01. The estimate below is for another build of the family.

What it is

Released byBAAI
Released2026-07-23
Parameters4.5B
VRAM245 GB for the weights

What it runs on

Memory and cards for AREX-Base (BF16)

245 GBweights, file size
25 MBcache per 1K tokens
307 MBfixed state per request
2.8 GBruntime overhead, at least
262,144 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB … B200 180 GB
12 smaller cards
———
2× H200 141 GB
tensor parallel
209all 256K138 GB a card
4× H100 80 GB
tensor parallel
3714all 256K78.1 GB a card
4× A100 80 GB
tensor parallel
7929all 256K78.2 GB a card
2× B200 180 GB
tensor parallel
15872all 256K176 GB a card
4× RTX PRO 6000 Blackwell 96 GB
tensor parallel
12646all 256K93.8 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
1248 GB249 GB
5250 GB253 GB
8252 GB257 GB
16256 GB266 GB
32264 GB284 GB
64280 GB319 GB

One card, with vLLM's small-card settings.

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
AREX-Turbo ↗ 4.5BBF16 9.1 GBRTX 3060 12 GB
AREX-Base (above) ↗ 122.6BBF16 245 GB2× H200 141 GB

From the model card

What BAAI says about AREX

Read the model card

Introduction

AREX is a family of deep research agents developed by the Beijing Academy of Artificial Intelligence (BAAI). It is designed for long-horizon tasks in which an agent must search across sources, assemble candidate answers, verify multiple constraints, and revise its research plan when the available evidence is incomplete.

AREX follows a recursive self-improvement framework consisting of an inner research loop and an outer self-improvement loop. The inner loop conducts deep research, while the outer loop evaluates and improves the research process.

This repository contains AREX-Turbo, the compact model in the AREX family. It is a dense 4B model built on Qwen3.5-4B and follows the same recursive deep research framework as AREX-Base. AREX-Turbo targets lower-cost research-agent deployment while retaining AREX's core research, verification, and context-management behavior.

  • Architecture: Dense
  • Parameters: 4B
  • Context length: 262,144 tokens

Key Features

  • Compact research agent: provides AREX capabilities in a dense 4B model for lower-cost serving and faster iteration.
  • Recursive self-improvement: evaluates provisional answers and chooses whether to accept, refine, or restart the research trajectory.
  • Verification-guided research: converts unresolved answer constraints into focused follow-up searches.
  • Autonomous context updates: retains verified findings, source identifiers, rejected candidates, open constraints, and the next research plan.
  • Long-horizon tool use: supports multi-round search, browsing, evidence integration, and answer construction.

Model Family

ModelBackboneContextLinksPositioning
AREX-BaseQwen3.5-122B-A10B256K🤗 Hugging Face · 🤖 ModelScopeHigher-capacity model with the strongest overall AREX results.
AREX-TurboQwen3.5-4B256K🤗 Hugging Face · 🤖 ModelScopeCompact model for lower-cost research and tool-use settings.

Method

AREX organizes deep research as two interacting loops supported by autonomous context management.

  1. Inner research loop. The agent searches, reads, integrates evidence, tracks candidates, and produces a provisional answer with supporting evidence and an answer-level confidence score.
  2. Outer self-improvement loop. The agent checks the provisional answer against the original constraints. High-confidence answers are accepted. Recoverable trajectories are refined around unresolved claims, while uninformative trajectories can be restarted.
  3. Autonomous context update. The model invokes update_context to refresh its research state around verified findings, current and rejected candidates, unresolved constraints, source validity, and the next research plan.

This design preserves useful work across iterations and reduces repeated exploration of paths that have already been rejected.

Evaluation

AREX is evaluated through a unified long-horizon search-agent interface with search, visit, update_context, and finish tools. HLE with tools additionally provides a Python tool.

Inference

See inference/README.md for OpenAI-compatible serving and generation examples. The folder also contains the complete, directly formattable system and user prompts used for BrowseComp.

Intended Use

AREX-Turbo is intended for research-agent applications that require long-horizon information seeking, evidence aggregation, multi-constraint verification, and tool-augmented reasoning under a smaller model footprint. It is suited to settings where serving cost, latency, or iteration speed matter.

License

AREX-Turbo is released under the Apache License 2.0.

Citation

@misc{baai2026arex,
      title={AREX: Towards a Recursively Self-Improving Agent for Deep Research},
      author={Shuqi Lu and Chaofan Li and Kun Luo and Zhang Zhang and Hui Wang and Hongwang Xiao and Lei Xiong and Jiahao Wang and Sen Wang and Xiyan Jiang and Wanli Li and Yuyang Hu and Hongjin Qian and Bingyu Yan and Ziyi Xia and Yingxia Shao and Kang Liu and Zhicheng Dou and Di He and Chaozhuo Li and Qiwei Ye and Zhongyuan Wang and Zheng Liu},
      year={2026},
      eprint={2607.21461},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2607.21461},
}

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms