Model reference · open weights

Millie-11GB

Available as managed deployment LLMs llmsforall Text gen · MoE 1 variants 727 dl/mo

Millie-11GB is an open-weight language model from llmsforall. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.

Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.

What it is

Released byllmsforall
TypeLanguage models
TaskText gen · MoE
Released2026-08-30
Popularity727 downloads / month
LicenceOpen weights

About

What Millie-11GB is

Millie is a 35B-parameter mixture-of-experts coding and agentic model (3B active per token, 262K context, image input) compressed to run on ordinary hardware. It is derived from Agents-A1, built on the Qwen3.5-35B-A3B architecture; expert weights are stored at ~2.2 bits per weight. A smaller 7 GB variant is also available.

Read the full model card

Files

FileSizeContents
Millie-35B-A3B-11GB.gguf10.3 GBlanguage model
Millie-35B-A3B-mmproj.gguf0.6 GBvision tower (image input)

Running it

The GGUF files require the llmsforall llama.cpp fork, which carries the kernels for their weight format (Metal, Vulkan, CPU); upstream llama.cpp cannot load them:

llama-server -m Millie-35B-A3B-11GB.gguf --mmproj Millie-35B-A3B-mmproj.gguf

License

Apache 2.0 — see LICENSE and NOTICE.

From the published model card. Full card on the HuggingFace links in the sidebar.

How it works

How language models work

Your prompttext / messagesTransformerattention over tokensNext-token loopgenerate + streamResponsetext · tool callsA language model reads your tokens and predicts the next one, again and again, streaming the reply back.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys millie-11gb for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (millie-11gb below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"millie-11gb","messages":[{"role":"user","content":"Hello"}]}'

Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms