Model reference · open weights
parler-tts-mini-multilingual is an open-weight audio or speech model from parler-tts, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
Parler-TTS Mini Multilingual v1.1 Parler-TTS Mini Multilingual v1.1 is a multilingual extension of Parler-TTS Mini. 🚨 As compared to Mini Multilingual v1, this version was trained with some consistent speaker names and with better format for descriptions. 🚨 It is a fine-tuned version, trained on a cleaned version of CML-TTS and on the non-English version of Multilingual LibriSpeech. In all, this represents some 9,200 hours of non-English data. To retain English capabilities, we also added back the LibriTTS-R English dataset, some 580h of high-quality English data. Parler-TTS Mini Multilingual can speak in 8 European languages: English, French, Spanish, Portuguese, Polish, German, Italian and Dutch. Thanks to its better prompt tokenizer, it can easily be extended to other languages. This tokenizer has a larger vocabulary and handles byte fallback, which simplifies multilingual training. 🚨 This work is the result of a collaboration between the HuggingFace audio team and the Quantum Squadra team. The AI4Bharat team also provided advice and assistance in improving tokenization. 🚨 📖 Quick Index 👨💻 Installation 🎲 Using a random voice 🎯 Using a specific speaker Motivation Optimizing inference 🛠️ Usage 🚨Unlike previous versions of Parler-TTS, here we use two tokenizers - one for the prompt and one for the description.🚨 👨💻 Installation Using Parler-TTS is as simple as "bonjour". Simply install the library once: 🎲 Random voice Parler-TTS Mini Multilingual has been trained to generate speech with features that can be controlled with a simple text prompt, for example: 🎯 Using a specific speaker To ensure speaker consistency across generations, this checkpoint was also trained on 16 speakers, characterized by name (e.g. Daniel, Christine, Richard, Nicole, ...). To take advantage of this, simply adapt your text description to specify which speaker to use: Daniel's voice is monotone yet slightly fast in delivery, with a very close recording that almost has no background noise. You can choose a speaker from this list: Tips: We've set up an inference guide to make generation faster. Think SDPA, torch.compile, batching and streaming! Include the term "very clear audio" to gener
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | parler-tts |
|---|---|
| Type | Audio & music |
| Parameters (lead) | 938M |
| Variants | 1 |
| Runs with | transformers |
| Released | 2024-11-22 |
| Popularity | 125k downloads / month |
| Likes | 58 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| parler-tts-mini-multilingual-v1.1 | 938M | BF16 | ~2.2 GB | ✓ | Weights ↗ |
Using it via the API
Once AxForge deploys parler-tts-mini-multilingual for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (parler-tts-mini-multilingual below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \ -H "Authorization: Bearer $AXFORGE_API_KEY" \ -F model="parler-tts-mini-multilingual" -F file=@audio.mp3
Licence
Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗