Model reference · open weights
Apodex-1.1-mini is an open-weight language model from apodex. Apodex-1.1-mini-NVFP4 (NVFP4) weighs 24.2 GB; the smallest configuration that runs it is 2× RTX 4060 Ti 16 GB.
Summary of the apodex/Apodex-1.1-mini-NVFP4 model card, 2026-10-01
What it is
| Released by | apodex |
|---|---|
| Released | 2026-08-17 |
| Parameters | 19.8B |
| VRAM | 24.2 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB … RTX 4090 24 GB 4 smaller cards | — | — | — | |
| RTX 5090 32 GB | 20 | 9 | all 256K | 31.0 GB |
| L40S 48 GB FP4 without its speed-up here | 81 | 37 | all 256K | 44.0 GB |
| A100 80 GB FP4 without its speed-up here | 242 | 110 | all 256K | 78.2 GB |
| H100 80 GB FP4 without its speed-up here | 211 | 96 | all 256K | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | 285 | 130 | all 256K | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | 349 | 159 | all 256K | 107 GB |
| H200 141 GB FP4 without its speed-up here | 493 | 225 | all 256K | 138 GB |
| B200 180 GB | 663 | 303 | all 256K | 176 GB |
| 2× RTX 4060 Ti 16 GB tensor parallel · FP4 without its speed-up here | 7 | 3 | 145K | 15.4 GB a card |
| 2× RTX 4090 24 GB tensor parallel · FP4 without its speed-up here | 82 | 37 | all 256K | 23.4 GB a card |
| 2× RTX 3090 24 GB tensor parallel · FP4 without its speed-up here | 82 | 37 | all 256K | 23.4 GB a card |
| 2× RTX 5090 32 GB tensor parallel | 154 | 70 | all 256K | 31.0 GB a card |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 26.9 GB | 27.2 GB |
| 5 | 27.7 GB | 29.0 GB |
| 8 | 28.4 GB | 30.4 GB |
| 16 | 30.1 GB | 34.1 GB |
| 32 | 33.5 GB | 41.5 GB |
| 64 | 40.3 GB | 56.4 GB |
One card, with vLLM's small-card settings.
From the model card
Apodex-1.1 is a reasoning-first model for complex, long-horizon research tasks. Beyond searching and writing reports, it works directly with files, data, code, and tools to complete tasks from input to verifiable deliverables. Powered by AgentOS and an asynchronous Agent Team, it can maintain task state, adapt its plan, coordinate parallel work, and incorporate user feedback throughout execution.
Try Apodex at apodex.ai.
To prevent potential information leakage (e.g., retrieving benchmark answers from public repositories), we block access to relevant benchmark-hosting websites during evaluation.
Apodex 1.1 Agent Team delivers frontier-level performance across professional work, finance, scientific research, and general reasoning, achieving 38.5 on APEX-Agents, 78.8 on GDPVal, 54.3 on FrontierFinance, 63.3 on FrontierScience-Research, 35.3 on BioMysteryBench, and 56.1 on Humanity’s Last Exam. It consistently improves over the ReAct setup across all six benchmarks and achieves the highest scores among the compared systems on FrontierFinance and FrontierScience-Research.
Apodex-1.1-mini remains competitive with frontier models, leading FrontierFinance with 50.2 and nearly matching the best result on APEX-Agent with 27.7. Its Agent Team setup also consistently outperforms ReAct across all three benchmarks. You can try Apodex-1.1-mini with our Agent Team harness.
Apodex follows the Qwen3.5 chat template — tool calls are emitted as and reasoning as .... Launch with the matching parsers so the server returns standard OpenAI-style tool_calls and reasoning_content fields.
We recommend deploying Apodex with the latest SGLang for an OpenAI-compatible endpoint.
SGLANG_ENABLE_SPEC_V2=1 python -m sglang.launch_server \
--model-path apodex/Apodex-1.1-mini-NVFP4 \
--quantization modelopt_mixed --moe-runner-backend flashinfer_trtllm \
--tp-size 1 \
--tool-call-parser qwen3_coder \
--reasoning-parser qwen3 \
--speculative-algorithm NEXTN --speculative-num-steps 3 \
--speculative-eagle-topk 1 --speculative-num-draft-tokens 4 \
--speculative-draft-model-quantization unquant \
--mamba-scheduler-strategy extra_buffer \
--mem-fraction-static 0.85 --context-length 262144 --language-only
For optimal performance in agentic tasks, we recommend:
temperature: 1.0
top_p: 0.95
repetition_penalty: 1.05
max_context_length: 262144
max_tokens: 32768
Apodex is trained for native function calling — tool schemas are passed via the tools= parameter of the chat-completions API and rendered into the prompt by the chat template, so the system prompt itself only needs to set the role and the high-level objective. We recommend the prompt below (this is the prompt used in our internal evaluation runs):
You are Apodex, an AI assistant developed by Apodex AI.
Apodex is the flagship agent of Apodex AI. Rather than a conventional conversational LLM, it is a general-purpose solver designed for mission-critical tasks.
Current time: {today_date}. In this environment you have access to a set of tools you can use to answer the user's question.
You only have access to the tools provided. You can use multiple tools per message, and will receive the results of those tools in the user's next response. You use tools step-by-step to accomplish a given task.
# General Objective
You accomplish a given task iteratively, breaking it down into clear steps and working through them methodically.
Substitute {today_date} with the current date (e.g. 2026-06-01). Do not inline tool descriptions in the system prompt — pass them via tools= so the Qwen3.5 chat template can emit the correct `` format and the server-side qwen3_coder parser can recover structured tool_calls for you.
The example below runs Apodex as a tool-using agent against an OpenAI-compatible endpoint (the SGLang / vLLM server launched above). The agent loops — executing the requested tools and feeding results back as role="tool" messages — until the model produces a final answer with no tool calls.
Before running, set the endpoint:
export OPENAI_API_KEY="EMPTY" # any non-empty string for local servers
export BASE_URL="http://localhost:1234/v1"
import json
import os
from datetime import date
from openai import OpenAI
# -------- 1. Tool implementations --------
def get_weather(location: str, unit: str = "celsius") -> str:
"""Get current weather information for a city (simulated)."""
table = {
"London": {"temperature": 15, "condition": "sunny", "humidity": 45},
"New York": {"temperature": 20, "condition": "cloudy", "humidity": 60},
"Tokyo": {"tempQuoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.