Model reference · open weights
Kimi-K3 is an open-weight embedding model from moonshotai. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Released by | moonshotai |
|---|---|
| Type | Embedding models |
| Task | Embeddings |
| Parameters (lead) | 1588.7B |
| Context | 1024k tokens |
| Runs with | transformers |
| Based on | moonshotai/Kimi-K3 |
| Released | 2026-07-30 |
| Popularity | 2k downloads / month |
| Licence | Open weights |
About
This is a quantized version of moonshotai/Kimi-K3 with MoE layers quantized to NVFP4 for accelerated inference.
This model is intended for deployment with vLLM. You can serve the model using
vllm serve RedHatAI/Kimi-K3-NVFP4 \
--tensor-parallel-size 8 \
--trust_remote_code \
--load-format instanttensor \
--reasoning-parser kimi_k3 \
--language-model-only # optional
May require https://github.com/vllm-project/vllm/pull/50500 to run
This model was compressed using LLM Compressor. For more information, please contact Kyle Sayers via the vLLM Developers Slack or ksayers@redhat.com.
| Benchmark | moonshotai/Kimi-K3 | RedHatAI/Kimi-K3-NVFP4 |
|---|---|---|
| GPQA | 93.5 | 91.0 |
inspect eval hf/Idavidrein/gpqa/diamond \
--model vllm/RedHatAI/Kimi-K3-NVFP4 \
--reasoning-effort high \
--model-base-url http://localhost:8000/v1
From the published model card. Full card on the HuggingFace links in the sidebar.
Using it via the API
Once AxForge deploys moonshotai-kimi-k3 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (moonshotai-kimi-k3 below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/embeddings \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"moonshotai-kimi-k3","input":"text to embed"}'
Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.