Model reference · open weights
SenseVoiceSmall is an open-weight audio or speech model from FunAudioLLM, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
(简体中文|English|日本語) ⭐ Powered by FunASR — please give us a GitHub Star! SenseVoice is part of the FunASR ecosystem — one industrial-grade open-source toolkit for ASR · VAD · punctuation · speaker diarization · emotion / event · LLM-ASR. A Star really helps the project (and keeps you updated): 🌟 FunASR · 🌟 SenseVoice · 🌟 Fun-ASR · 🌟 FunClip ⚡ CPU / edge — no GPU, no Python: run SenseVoiceSmall as a single self-contained binary via llama.cpp / GGUF (like whisper.cpp), with built-in VAD. Prebuilt binaries + one-command model download → SenseVoiceSmall-GGUF · runtime · guide Introduction github repo : https://github.com/FunAudioLLM/SenseVoice SenseVoice is a speech foundation model with multiple speech understanding capabilities, including automatic speech recognition (ASR), spoken language identification (LID), speech emotion recognition (SER), and audio event detection (AED). [//]: # (<div align="center"<img src="image/sensevoice.png" width="700"/ </div) ｜<a href="#What's News" What's News </a ｜<a href="#Benchmarks" Benchmarks </a ｜<a href="#Install" Install </a ｜<a href="#Usage" Usage </a ｜<a href="#Community" Community </a Model Zoo: modelscope, huggingface Online Demo: modelscope demo, huggingface space Highlights 🎯 SenseVoice focuses on high-accuracy multilingual speech recognition, speech emotion recognition, and audio event detection. - Multilingual Speech Recognition: Trained with over 400,000 hours of data, supporting more than 50 languages, the recognition performance surpasses that of the Whisper model. - Rich transcribe: - Possess excellent emotion recognition capabilities, achieving and surpassing the effectiveness of the current best emotion recognition models on test data. - Offer sound event detection capabilities, supporting the detection of various common human-computer interaction events such as bgm, applause, laughter, crying, coughing, and sneezing. - Efficient Inference: The SenseVoice-Small model utilizes a non-autoregressive end-to-end framework, leading to exceptionally low inference latency. It requires only 70ms to process 10 seconds of audio, which is 15 times faster than Whisper-Large. - Convenient Finetuning: Provide convenient finetuni
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | FunAudioLLM |
|---|---|
| Type | Audio & music |
| Variants | 1 |
| Runs with | funasr |
| Released | 2024-07-03 |
| Popularity | 33k downloads / month |
| Likes | 466 |
| Licence | Commercial licence needed |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| SenseVoiceSmall | — | BF16 | — | — | Weights ↗ |
Using it via the API
Once AxForge deploys sensevoicesmall for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (sensevoicesmall below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \ -H "Authorization: Bearer $AXFORGE_API_KEY" \ -F model="sensevoicesmall" -F file=@audio.mp3
Details
Languages
Tags
Licence
The weights are open but its licence needs a commercial agreement for business use. AxForge can arrange that licence and host the model for you — you pay AxForge, we settle with the model’s maker. Ask us for a quote. Read the licence ↗