Model reference · open weights
Fun-ASR-Nano-2512 is an open-weight audio or speech model from FunAudioLLM. Fun-ASR-Nano-2512-hf (BF16) weighs 1.7 GB; the smallest configuration that runs it is RTX 3060 12 GB.
Summary of the FunAudioLLM/Fun-ASR-Nano-2512-GGUF model card, 2026-10-01. The estimate below is for another build of the family.
What it is
| Released by | FunAudioLLM |
|---|---|
| Released | 2026-07-29 |
| VRAM | 1.7 GB for the weights |
What it runs on
| Card | One stream | Memory |
|---|---|---|
| RTX 3060 12 GB | fits | 11.6 GB |
| RTX 4060 Ti 16 GB | fits | 15.4 GB |
| RTX 3090 24 GB | fits | 23.4 GB |
| RTX 4090 24 GB | fits | 23.4 GB |
| RTX 5090 32 GB | fits | 31.0 GB |
| L40S 48 GB | fits | 44.0 GB |
| A100 80 GB | fits | 78.2 GB |
| H100 80 GB | fits | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | fits | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | fits | 107 GB |
| H200 141 GB | fits | 138 GB |
| B200 180 GB | fits | 176 GB |
Builds
| Build | Params | Precision | Weights | Smallest setup |
|---|---|---|---|---|
| Fun-ASR-Nano-2512-GGUF ↗ 2 builds: Q8_0 1.0 GB … F16 1.7 GB |
— | GGUF | 1.7 GB | RTX 3060 12 GB |
| Fun-ASR-Nano-2512-hf (above) ↗ | 830M | BF16 | 1.7 GB | RTX 3060 12 GB |
| Fun-ASR-Nano-2512 ↗ | — | BF16 | 2.0 GB | RTX 3060 12 GB |
From the model card
Standalone audio.cpp GGUF builds of FunAudioLLM/Fun-ASR-Nano-2512-hf. Each file embeds the model configuration, processor configuration, tokenizer, chat template, and the audio.cpp model package specification.
| File | Size | SHA256 |
|---|---|---|
fun-asr-nano-2512-q8_0.gguf | 1,045,334,432 bytes | 4d727357574b079b7f43336b2930f39da086ca02f5d8d50872090b4c1c3d5e0a |
fun-asr-nano-2512-f16.gguf | 1,675,708,832 bytes | 3d906c3ccfed07efef88ff53d6cc94b788b9d2edf1492a5679d041b43e98c5be |
The source checkpoint is pinned to revision
854d88f94205cd17d2afdb24332130d86fbe654a. The source
model.safetensors SHA256 is
335ca3e74917f1156690400e2c344350112950165789cf78ce3d0a367affd821.
audiocpp_cli \
--task asr \
--family fun_asr_nano \
--model fun-asr-nano-2512-q8_0.gguf \
--backend cuda \
--audio speech.wav
Fun-ASR-Nano currently provides offline multilingual ASR. It does not expose
streaming or timestamp output. On CUDA, audio.cpp keeps the Q8_0 encoder and
adaptor weights native and loads decoder weights as BF16 by default for stable
logits. An explicit fun_asr_nano.decoder_weight_type session option overrides
that default.
The files were generated with audio.cpp's audiocpp_gguf converter:
audiocpp_gguf \
--input model.safetensors \
--root /path/to/Fun-ASR-Nano-2512-hf \
--output fun-asr-nano-2512-q8_0.gguf \
--type q8_0 \
--family fun_asr_nano \
--model-spec model_specs/fun_asr_nano.json
Both formats were checked with audiocpp_gguf --inspect and full reference
audio transcription on CPU and NVIDIA H100 CUDA.
The original model and these converted weights are governed by the FunASR Model Open Source License Agreement v1.1 distributed with the source model. Review that agreement before using or redistributing the files.
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.
How it works