Model reference · open weights

Kimi-K2-0905

LLMs moonshotai Text gen 1 build Its own licence terms 39k dl/mo

Kimi-K2-0905 is an open-weight language model from moonshotai. Kimi-K2-Instruct-0905 (FP8) weighs 1029 GB; the smallest configuration that runs it is 8× B200 180 GB.

  • Kimi-K2-0905 is a text-generation model developed by moonshotai that uses a mixture-of-experts architecture with 1 trillion total parameters and 32 billion activated parameters.
  • It supports a context length of 262,144 tokens and is designed for agentic coding tasks.
  • The model is released under a Modified MIT License.

Summary of the moonshotai/Kimi-K2-Instruct-0905 model card, 2026-10-01

What it is

Released bymoonshotai
Released2025-09-03
Parameters1026.5B
VRAM1029 GB for the weights

What it runs on

Memory and cards for Kimi-K2-Instruct-0905 (FP8)

1029 GBweights, file size
70 MBcache per 1K tokens
2.4 GBruntime overhead, at least
262,144 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB … 8× H200 141 GB
15 smaller cards
———
8× B200 180 GB
tensor parallel
4912all 256K176 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
11032 GB1034 GB
51034 GB1043 GB
81036 GB1050 GB
161041 GB1068 GB
321050 GB1105 GB
641068 GB1179 GB

One card, with vLLM's small-card settings.

From the model card

What moonshotai says about Kimi-K2-0905

Read the model card

1. Model Introduction

Kimi K2-Instruct-0905 is the latest, most capable version of Kimi K2. It is a state-of-the-art mixture-of-experts (MoE) language model, featuring 32 billion activated parameters and a total of 1 trillion parameters.

Key Features

  • Enhanced agentic coding intelligence: Kimi K2-Instruct-0905 demonstrates significant improvements in performance on public benchmarks and real-world coding agent tasks.
  • Improved frontend coding experience: Kimi K2-Instruct-0905 offers advancements in both the aesthetics and practicality of frontend programming.
  • Extended context length: Kimi K2-Instruct-0905’s context window has been increased from 128k to 256k tokens, providing better support for long-horizon tasks.

2. Model Summary

ArchitectureMixture-of-Experts (MoE)
Total Parameters1T
Activated Parameters32B
Number of Layers (Dense layer included)61
Number of Dense Layers1
Attention Hidden Dimension7168
MoE Hidden Dimension (per Expert)2048
Number of Attention Heads64
Number of Experts384
Selected Experts per Token8
Number of Shared Experts1
Vocabulary Size160K
Context Length256K
Attention MechanismMLA
Activation FunctionSwiGLU

3. Evaluation Results

BenchmarkMetricK2-Instruct-0905K2-Instruct-0711Qwen3-Coder-480B-A35B-InstructGLM-4.5DeepSeek-V3.1Claude-Sonnet-4Claude-Opus-4
SWE-Bench verifiedACC69.2 ± 0.6365.869.6*64.2*66.0*72.7*72.5*
SWE-Bench MultilingualACC55.9 ± 0.7247.354.7*52.754.5*53.3*-
Multi-SWE-BenchACC33.5 ± 0.2831.332.731.729.035.7-
Terminal-BenchACC44.5 ± 2.0337.537.5*39.9*31.3*36.4*43.2*
SWE-DevACC66.6 ± 0.7261.964.763.253.367.1-

All K2-Instruct-0905 numbers are reported as mean ± std over five independent, full-test-set runs. Before each run we prune the repository so that every Git object unreachable from the target commit disappears; this guarantees the agent sees only the code that would legitimately be available at that point in history.

Except for Terminal-Bench (Terminus-2), every result was produced with our in-house evaluation harness. The harness is derived from SWE-agent, but we clamp the context windows of the Bash and Edit tools and rewrite the system prompt to match the task semantics. All baseline figures denoted with an asterisk (*) are excerpted directly from their official report or public leaderboard; the remaining metrics were evaluated by us under conditions identical to those used for K2-Instruct-0905.

For SWE-Dev we go one step further: we overwrite the original repository files and delete any test file that exercises the functions the agent is expected to generate, eliminating any indirect hints about the desired implementation.

4. Deployment

[!Note] You can access Kimi K2's API on https://platform.moonshot.ai , we provide OpenAI/Anthropic-compatible API for you.

The Anthropic-compatible API maps temperature by real_temperature = request_temperature * 0.6 for better compatible with existing applications.

Our model checkpoints are stored in the block-fp8 format, you can find it on Huggingface.

Currently, Kimi-K2 is recommended to run on the following inference engines:

  • vLLM
  • SGLang
  • KTransformers
  • TensorRT-LLM

Deployment examples for vLLM and SGLang can be found in the Model Deployment Guide.


5. Model Usage

Chat Completion

Once the local inference service is up, you can interact with it through the chat endpoint:

def simple_chat(client: OpenAI, model_name: str):
    messages = [
        {"role": "system", "content": "You are Kimi, an AI assistant created by Moonshot AI."},
        {"role": "user", "content": [{"type": "text", "text": "Please give a brief self-introduction."}]},
    ]
    response = client.chat.completions.create(
        model=model_name,
        messages=messages,
        stream=False,
        temperature=0.6,
        max_tokens=256
    )
    print(response.choices[0].message.content)

[!NOTE] The recommended temperature for Kimi-K2-Instruct-0905 is temperature = 0.6. If no special instructions are required, the system prompt above is a good default.


Tool Calling

Kimi-K2-Instruct-0905 has strong tool-calling capabilities. To enable them, you need to pass the list of available tools in each request, then the model will autonomously decide when and how to invoke them.

The following example demonstrates calling a weather tool end-to-end:

# Your tool implementation
def get_weather(city: str) -> dict:
    return {"weather": "Sunny"}
# Tool schema definition
tools = [{
    "type": "function",
    "function": {
        "name": "get_weather",
        "description": "Retrieve current weather information. Call this when the user asks about the weather.",
        "parameters": {
            "type": "object",
            "required": ["city"],
            "properties": {
                "city": {
                    "type": "string",
                    "description": "Name of the city"
                }
            }
        }
    }
}]
# Map tool names to their implementations
tool_map = {
    "get_weather": get_weather
}
def tool_call_with_client(client: OpenAI, model_name: str):
    messages = [

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms