Model reference · open weights
Millie-11GB is an open-weight language model from llmsforall. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Released by | llmsforall |
|---|---|
| Type | Language models |
| Task | Text gen · MoE |
| Released | 2026-08-30 |
| Popularity | 727 downloads / month |
| Licence | Open weights |
About
Millie is a 35B-parameter mixture-of-experts coding and agentic model (3B active per token, 262K context, image input) compressed to run on ordinary hardware. It is derived from Agents-A1, built on the Qwen3.5-35B-A3B architecture; expert weights are stored at ~2.2 bits per weight. A smaller 7 GB variant is also available.
| File | Size | Contents |
|---|---|---|
| Millie-35B-A3B-11GB.gguf | 10.3 GB | language model |
| Millie-35B-A3B-mmproj.gguf | 0.6 GB | vision tower (image input) |
The GGUF files require the llmsforall llama.cpp fork, which carries the kernels for their weight format (Metal, Vulkan, CPU); upstream llama.cpp cannot load them:
llama-server -m Millie-35B-A3B-11GB.gguf --mmproj Millie-35B-A3B-mmproj.gguf
Apache 2.0 — see LICENSE and NOTICE.
From the published model card. Full card on the HuggingFace links in the sidebar.
How it works
Using it via the API
Once AxForge deploys millie-11gb for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (millie-11gb below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"millie-11gb","messages":[{"role":"user","content":"Hello"}]}'
Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.