Model reference · open weights
OmniVoice is an open-weight audio or speech model from Serveurperso, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
OmniVoice GGUF GGUF weights for omnivoice.cpp, a C++17/GGML port of OmniVoice (k2-fsa/OmniVoice). Multilingual zero shot TTS, 646 languages, 24 kHz mono. Runs on CPU, CUDA, ROCm, Metal, Vulkan. Files Two GGUFs load together : omnivoice-base-{variant}.gguf Qwen3 0.6B backbone, text - tokens omnivoice-tokenizer-{variant}.gguf HuBERT + DAC + RVQ, tokens <- 24 kHz audio Quick start Backends Set GGMLBACKEND to force a device, otherwise the runtime picks the best one available. Quantization policy Tokenizer GGUFs are not uniform quants. Three categories get a dedicated treatment : Same fallback as llama.cpp tensortypefallback : F16 has no block size and matches the runtime target dtype on every backend. The base LM (Qwen3 0.6B, hidden = 1024) has all dimensions divisible by 256 so the fallback never triggers, the LM follows standard llama.cpp K-quant across variants. License Upstream model : OmniVoice by Xiaomi / k2-fsa, Apache 2.0 Audio codec : Higgs Audio v2 (bosonai/higgs-audio-v2-tokenizer), Apache 2.0 GGUF tooling : omnivoice.cpp, MIT
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | Serveurperso |
|---|---|
| Type | Audio & music |
| Variants | 1 |
| Runs with | gguf |
| Based on | k2-fsa/OmniVoice |
| Released | 2026-04-27 |
| Popularity | 188k downloads / month |
| Likes | 52 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| OmniVoice-GGUF | — | GGUF | — | — | Weights ↗ |
Using it via the API
Once AxForge deploys serveurperso-omnivoice for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (serveurperso-omnivoice below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \ -H "Authorization: Bearer $AXFORGE_API_KEY" \ -F model="serveurperso-omnivoice" -F file=@audio.mp3
Details
Languages
Tags
Licence
Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗