A.X-K2-Raon-Speech

About

What A.X-K2-Raon-Speech is

A.X K2 Raon-Speech A.X K2 Raon-Speech is a bilingual English/Korean speech language model with approximately 21.2B total parameters and 3.5B active parameters. Built on SK Telecom's A.X K2 Light 20B-A3B mixture-of-experts text backbone, it integrates an AuT speech encoder and a Mimi-style neural audio codec independently trained by KRAFTON AI, unifying speech understanding and generation in a single multimodal model. It is trained with the recipe of Raon-Speech-9B, KRAFTON's open-source speech language model. Key Features - End-to-End Speech Language Model: 21.2B-parameter (approximately 3.5B active) multimodal model built on SK Telecom's A.X K2 Light 20B-A3B mixture-of-experts backbone. - Independently Trained Speech Modules: AuT speech encoder (approximately 317M parameters) and Mimi-style neural audio codec (approximately 96M parameters), trained on curated data with an in-house pipeline. - Bilingual Support: First in Korean and third in English aggregate score among publicly available speech language models at or below the 30B scale. - Multi-Task Capabilities: STT, TTS, SpeechQA, SpokenQA, and turn-based multimodal chat in a single unified model. - Paralinguistic Awareness: Uses emotion, intonation, and other information carried in the user's voice to generate natural spoken responses. - Speaker Voice Conditioning: TTS with optional speaker reference audio via ECAPA embeddings. - TTS Continuation: Generates speech that naturally continues from a reference audio with prefill-based continuation for seamless prosody. Architecture All components for the core speech-understanding and direct-TTS paths are included in the checkpoint. Speaker-conditioned and continuation TTS additionally use a frozen SpeechBrain ECAPA speaker encoder, downloaded automatically on first use. Evaluation Evaluation covered six task areas — speech recognition, speech synthesis, speech understanding, spoken question answering, text question answering, and tool calling — using 46 benchmarks (24 Korean, 22 English), including LibriSpeech, KsponSpeech, VoiceBench, KVoiceBench, MMAU, KMMAU, API-Bank, and FunctionChat-Bench. Each result is normalized to the 0–1 range and aggregated per languag

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

How it works

How language models work

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys a-x-k2-raon-speech for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (a-x-k2-raon-speech below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"a-x-k2-raon-speech","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Licence

Commercial licence needed

Sources

Weights & code

Explore

More language models