Model reference · open weights
Paraformer is an open-weight audio or speech model from FunAudioLLM. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Released by | FunAudioLLM |
|---|---|
| Type | Audio & music |
| Task | Speech→text |
| Runs with | gguf |
| Released | 2026-06-20 |
| Popularity | 655 downloads / month |
| Licence | Open weights |
About
GGUF build of FunASR's Paraformer-zh (SAN-M encoder + CIF predictor + SAN-M decoder, non-autoregressive) for the zero-Python, CPU/edge FunASR llama.cpp runtime — fast Mandarin ASR, ~21× real-time on CPU.
These are GGUF weights for the FunASR llama.cpp runtime — a whisper.cpp-style, single self-contained binary for CPU / edge. Grab a prebuilt binary, then fetch this model and run:
runtime-llamacpp-v*)bash download-funasr-model.sh paraformer ./gguf
llama-funasr-paraformer -m ./gguf/paraformer-q8.gguf --vad ./gguf/fsmn-vad.gguf -a audio.wav
| file | size | notes |
|---|---|---|
paraformer-f16.gguf | 435 MB | recommended (f16 matmul weights) |
paraformer-q8.gguf | ~217 MB | recommended — half of f16, same accuracy |
paraformer.gguf | 863 MB | f32 reference |
The binary prints transcription text directly (no Python detok). --ids for raw ids.
llama-funasr-paraformer -m paraformer-f16.gguf -a audio.wav --vad fsmn-vad.gguf
On CPU (8 threads): 9.85 % CER on the 184-clip Mandarin benchmark (vs whisper.cpp 22–31 %).
From the published model card. Full card on the HuggingFace links in the sidebar.
How it works
Using it via the API
Once AxForge deploys paraformer for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (paraformer below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \ -H "Authorization: Bearer $AXFORGE_API_KEY" \ -F model="paraformer" -F file=@audio.mp3
Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.