Model reference · open weights
VibeVoice-Realtime is an open-weight audio or speech model from microsoft, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
VibeVoice: A Frontier Open-Source Text-to-Speech Model VibeVoice-Realtime is a lightweight real‑time text-to-speech model supporting streaming text input and robust long-form speech generation. It can be used to build realtime TTS services, narrate live data streams, and let different LLMs start speaking from their very first tokens (plug in your preferred model) long before a full answer is generated. It produces initial audible speech in ~300 ms (hardware dependent). ▶️ Watch demo video (Launch your own realtime demo via the websocket example in Usage) Although the model is primarily built for English, we found that it still exhibits a certain level of multilingual capability—and even performs reasonably well in some languages. We provide nine additional languages (German, French, Italian, Japanese, Korean, Dutch, Polish, Portuguese, and Spanish) for users to explore and share feedback. The model uses an interleaved, windowed design: it incrementally encodes incoming text chunks while, in parallel, continuing diffusion-based acoustic latent generation from prior context. Unlike the full multi-speaker long-form variants, this streaming model removes the semantic tokenizer and relies solely on an efficient acoustic tokenizer operating at an ultra-low frame rate (7.5 Hz). Key features: - Parameter size: 0.5B (deployment-friendly) - Realtime TTS (~300 ms first audible latency) - Streaming text input - Robust long-form speech generation This realtime variant supports only a single speaker. For multi-speaker conversational speech generation, please use other VibeVoice models. The model is currently intended for English speech only; other languages may produce unpredictable results. ➡️ Technical Report: VibeVoice Technical Report ➡️ Project Page: microsoft/VibeVoice ➡️ Code: microsoft/VibeVoice-Code ➡️ App: anycoderapps/VibeVoice-Realtime-0.5B Training Details Transformer-based Large Language Model (LLM) integrated with specialized acoustic tokenizer and a diffusion-based decoding head. - LLM: Qwen2.5-0.5B for this release. - Tokenizers: - Acoustic Tokenizer: Based on a σ-VAE variant (proposed in LatentLM), with a mirror-symmetric encoder-decoder structure featuring
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | microsoft |
|---|---|
| Type | Audio & music |
| Parameters (lead) | 1.0B |
| Variants | 1 |
| Runs with | transformers |
| Based on | Qwen/Qwen2.5-0.5B |
| Released | 2025-12-04 |
| Popularity | 599k downloads / month |
| Likes | 1,279 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| VibeVoice-Realtime-0.5B | 1.0B | BF16 | ~2.3 GB | ✓ | Weights ↗ |
Using it via the API
Once AxForge deploys vibevoice-realtime for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (vibevoice-realtime below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \ -H "Authorization: Bearer $AXFORGE_API_KEY" \ -F model="vibevoice-realtime" -F file=@audio.mp3
Licence
Open weights under mit — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗