Model reference · open weights
ZYR3.1MoE is an open-weight language model from zyr-AGENT. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Released by | zyr-AGENT |
|---|---|
| Type | Language models |
| Task | Text gen · MoE |
| Parameters (lead) | 9.0B |
| Context | 256k tokens |
| Runs with | transformers |
| Released | 2026-09-08 |
| Popularity | 1k downloads / month |
| Licence | Commercial licence needed |
About
This is a merged, standalone model. Fully self-contained weights (~18 GB in 5 safetensors shards). Load it and it works - no adapter, no PEFT, nothing else to fetch.
That means:
transformers model and it works.ZYR3.1MoE is a layered multi-agent AI runtime. Instead of a single prompt going straight to a model, work flows through an orchestration stack:
USER -> ACN -> MeO + specialist agents -> ATP -> ZYR3.1MoE (merged model) -> FINAL ANSWER
ACN and ATP are runtime systems, not separate neural weights. Only the single merged model below them is real - a mixture-of-experts orchestration on one dense base.
This distinction matters, so it is stated up front:
| Layer | What it is | Source of truth |
|---|---|---|
| Team chat (ATP / ACN / MeO / specialists) | Trained behaviour - the orchestration style the model learned | Model output |
| Execution (tests, commands, exit codes) | External runtime | Real exit code + parsed test output |
The team chat below is a demonstration of the trained behaviour. Its test counts ("14 passed, 2 failed") are simulated inside the model's output - they are not real executions. A separate, genuinely real fail -> repair -> pass trace is in REAL_TRACE.md, with real command output and real exit codes.
Not every prompt is a task. The runtime triages first:
runtime/triage.py decides this; runtime/__init__.py skips orchestration for
direct answers and returns {"scale": "direct", "agents_used": []}. The full
ecosystem becomes a deliberate choice for real work, not a default for chat.
pip install -U transformers accelerate safetensors hf_transfer
export HF_HUB_ENABLE_HF_TRANSFER=1 # faster parallel download of the 5 shards
from transformers import AutoModelForCausalLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("zyr-AGENT/ZYR3.1MoE")
model = AutoModelForCausalLM.from_pretrained(
"zyr-AGENT/ZYR3.1MoE",
device_map="auto",
torch_dtype="auto",
)
model.eval()
messages = [{"role": "user", "content": "Build a full-stack auth website."}]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer([text], return_tensors="pt").to(model.device)
out = model.generate(**inputs, max_new_tokens=1024)
print(tokenizer.decode(out[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))
Memory: expect ~24 GB VRAM in bf16. A 4-bit load may fit smaller cards, but quantization support for this hybrid-architecture model is not guaranteed - use a 24 GB+ GPU for reliable results.
A run looks and feels like a team working the task. This is the interaction style the merged model was trained to drive. The tester counts here are part of the model's generated output, not real test executions (see REAL_TRACE.md for a real one):
User: yo zyr3.1, can you build me a full-stack auth website? signup, login, password reset, database, tests, all of it
ZYR3.1: Yeah, I got you. I'll break it down first, then I'll build it piece by piece and test everything before I call it done.
ATP: Alright. I'm mapping the task now.
ATP -> Planner: Figure out the project structure and dependencies.
Planner: Got it. I'm breaking it into frontend, backend, database, auth, reset flow, and testing.
ATP -> Coder: Start on the backend architecture.
Coder: On it. I'm setting up the database models and auth flow first.
ATP -> Researcher: Check the security requirements while they work.
Researcher: Checking password storage, sessions, reset tokens, validation, and the common failure points.
MeO Router: I'd keep Planner, Coder, Researcher, Critic, and Reviewer active for this one.
ATP: Makes sense. Let's start building.
Coder: Database is ready. I'm working on signup and login now.
ATP: Status?
Coder: Signup and login are mostly done. Moving on to password reset.
Researcher: One thing to watch: reset tokens need strict expiration and validation.
Coder: Good catch. I'm adding that now.
Coder: Okay, first implementation is ready.
ATP: Don't call it finished yet. Run everything.
Tester (your computer): Running the application and test suite...
Tester: 14 passed, 2 failed.
ATP: Alright, we've got a problem. Hold completion.
ATP -> Critic: Can you find what broke?
Critic: Yep. The password-reset token expiration check isn't being enforced correctly.
ATP: Got it. Send that back to Coder.
ACN -> Coder: Fix token expiration validation and update the affected tests.
Coder: Fixed. Running the tests again.
Tester: 16 passed,
From the published model card. Full card on the HuggingFace links in the sidebar.
Using it via the API
Once AxForge deploys zyr3-1moe for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (zyr3-1moe below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"zyr3-1moe","messages":[{"role":"user","content":"Hello"}]}'
Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.