Model reference · open weights
TIGER-speech is an open-weight audio or speech model from JusperLee. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Maker | JusperLee |
|---|---|
| Type | Audio & music |
| Task | Audio→audio |
| Parameters (lead) | 1M |
| Released | 2025-01-22 |
| Popularity | 8k downloads / month |
| Licence | Open weights |
About
TIGER is a lightweight model for speech separation which effectively extracts key acoustic features through frequency band-split, multi-scale and full-frequency-frame modeling.
In this paper, we propose a speech separation model with significantly reduced parameter size and computational cost: Time-Frequency Interleaved Gain Extraction and Reconstruction Network (TIGER). TIGER leverages prior knowledge to divide frequency bands and applies compression on frequency information. We employ a multi-scale selective attention (MSA) module to extract contextual features, while introducing a full-frequency-frame attention (F^3A) module to capture both temporal and frequency contextual information. Additionally, to more realistically evaluate the performance of speech separation models in complex acoustic environments, we introduce a novel dataset called EchoSet. This dataset includes noise and more realistic reverberation (e.g., considering object occlusions and material properties), with speech from two speakers overlapping at random proportions. Experimental results demonstrated that TIGER significantly outperformed state-of-the-art (SOTA) model TF-GridNet on the EchoSet dataset in both inference speed and separation quality, while reducing the number of parameters by 94.3% and the MACs by 95.3%. These results indicate that by utilizing frequency band-split and interleaved modeling structures, TIGER achieves a substantial reduction in parameters and computational costs while maintaining high performance. Notably, TIGER is the first speech separation model with fewer than 1 million parameters that achieves performance close to the SOTA model.
Overall pipeline of the model architecture of TIGER and its modules.
Performance comparisons of TIGER and other existing separation models on Libri2Mix, LRS2-2Mix, and EchoSet. Bold indicates optimal performance, and italics indicate suboptimal performance.
Efficiency comparisons of TIGER and other models.
Comparison of performance and efficiency of cinematic sound separation models on DnR. '*' means the result comes from the original paper of DnR.
git clone https://github.com/JusperLee/TIGER.git
cd TIGER
pip install -r requirements.txt
# Test using speech
python inference_speech.py --audio_path test/mix.wav
# Test using DnR
python inference_dnr.py --audio_path test/test_mixture_466.wav
python audio_train.py --conf_dir configs/tiger.yml
python audio_test.py --conf_dir configs/tiger.yml
@article{xu2024tiger,
title={TIGER: Time-frequency Interleaved Gain Extraction and Reconstruction for Efficient Speech Separation},
author={Xu, Mohan and Li, Kai and Chen, Guo and Hu, Xiaolin},
journal={arXiv preprint arXiv:2410.01469},
year={2024}
}
If you have any questions, please feel free to contact us via tsinghua.kaili@gmail.com.
From the published model card. Full card on the HuggingFace links in the sidebar.
How it works
Using it via the API
Once AxForge deploys tiger-speech for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (tiger-speech below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \ -H "Authorization: Bearer $AXFORGE_API_KEY" \ -F model="tiger-speech" -F file=@audio.mp3
Create an account — your API key is available in the console. 5M tokens/month currently included with every new account at launch.