Xing4.0

Highlights

• Agent-Oriented Architecture: Built on the mHC + MLA + MTP architecture, supporting multi-step planning, tool calling, and complex reasoning chain execution, ensuring task coherence and execution stability under long contexts.
• Deep Co-optimization with Ascend NPU: Adapted for Ascend 910C clusters using MindSpore/MindFormers, including feature adaptation for mHC and fused operator development, enabling stable and efficient training on the Ascend platform.
• Significant Training Efficiency Gains: Through multi-level co-optimization — including fine-grained MoE communication optimization, selective recomputation, DVM automatic graph-operator fusion, and Ascend C mHC fused operators — overall training throughput was improved by approximately 96% over out-of-the-box performance.
• Full Open-Source Ecosystem Compatibility: Supports LLaMA-Factory and MindFormers for fine-tuning; SGLang, vLLM, and KTransformers for inference and deployment; with targeted adaptation and format alignment for agent frameworks such as OpenCode, Claude Code, OpenClaw, and Hermes, enabling seamless integration into existing workflows.
• Easy Adaptation for Domain-Specific Scenarios: The model is well-suited for downstream task fine-tuning, allowing lightweight customization on proprietary data for vertical domains such as intent classification, table understanding, contract auditing, and knowledge-based QA, enabling rapid domain capability development and deployment at low cost.

Model Overview

Benchmark

Quickstart

Inference

Xing4.0-29B-A4B can be accessed via an OpenAI-compatible API.

from openai import OpenAI

client = OpenAI(
    base_url="your-base-url",
    api_key="your-api-key",
)

completion = client.chat.completions.create(
    model="Xing4.0-29B-A4B",
    messages=[{"role": "user", "content": "Briefly explain the basic principles of quantum computing."}],
    temperature=1.0,
    top_p=0.95,
    extra_body={
        "repetition_penalty": 1.05,
        "skip_special_tokens": False,
        "spaces_between_special_tokens": False,
        "chat_template_kwargs": {
            "enable_thinking": True,  # Set to False to disable thinking
        },
    },
)

print(completion.choices[0].message.content)

Serving

Xing4.0-29B-A4B supports deployment with vLLM, SGLang, and KTransformers. For detailed launch instructions, please refer to our GitHub repository.

Recommended Parameters

Footnotes

• SWE-bench Verified: We evaluate Xing4.0-29B-A4B using the SWE-agent harness with temperature=1.0, top_p=0.95, repetition_penalty=1.05 and a 210K context window.
• Terminal-Bench 2.1: We evaluate in terminus-2 with temperature=0.8, top_p=0.95, repetition_penalty=1.05, max_tokens=64K and a 24-hour timeout. We report the average score over 3 runs.
• SWE-bench Multilingual: We evaluate Xing4.0-29B-A4B using the SWE-agent harness with temperature=1.0, top_p=0.95, repetition_penalty=1.05 and a 210K context window.
• Claw-Eval: We evaluate using the official harness with temperature=0.8, top_p=0.95, repetition_penalty=1.05, max_tokens=16384 and a 256K context window. We report the average score over 3 runs.
• Tau3-Bench: We evaluate using the official harness with temperature=0.8, top_p=0.95, repetition_penalty=1.05, max_tokens=16384. We report the average pass^1 over 4 runs.
• DeepresearchBII: We evaluate using the OpenCode harness with `temperature=0.8, top_p=0.95,