Model reference · open weights
XTTS is an open-weight audio or speech model from coqui, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
ⓍTTS ⓍTTS is a Voice generation model that lets you clone voices into different languages by using just a quick 6-second audio clip. There is no need for an excessive amount of training data that spans countless hours. This is the same or similar model to what powers Coqui Studio and Coqui API. Features - Supports 17 languages. - Voice cloning with just a 6-second audio clip. - Emotion and style transfer by cloning. - Cross-language voice cloning. - Multi-lingual speech generation. - 24khz sampling rate. Updates over XTTS-v1 - 2 new languages; Hungarian and Korean - Architectural improvements for speaker conditioning. - Enables the use of multiple speaker references and interpolation between speakers. - Stability improvements. - Better prosody and audio quality across the board. Languages XTTS-v2 supports 17 languages: English (en), Spanish (es), French (fr), German (de), Italian (it), Portuguese (pt), Polish (pl), Turkish (tr), Russian (ru), Dutch (nl), Czech (cs), Arabic (ar), Chinese (zh-cn), Japanese (ja), Hungarian (hu), Korean (ko) Hindi (hi). Stay tuned as we continue to add support for more languages. If you have any language requests, feel free to reach out! Code The code-base supports inference and fine-tuning. Demo Spaces - XTTS Space : You can see how model performs on supported languages, and try with your own reference or microphone input - XTTS Voice Chat with Mistral or Zephyr : You can experience streaming voice chat with Mistral 7B Instruct or Zephyr 7B Beta License This model is licensed under Coqui Public Model License. There's a lot that goes into a license for generative models, and you can read more of the origin story of CPML here. Contact Come and join in our 🐸Community. We're active on Discord and Twitter. You can also mail us at info@coqui.ai. Using 🐸TTS API: Using 🐸TTS Command line: Using the model directly:
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | coqui |
|---|---|
| Type | Audio & music |
| Variants | 1 |
| Runs with | coqui |
| Released | 2023-10-31 |
| Popularity | 7.9M downloads / month |
| Likes | 3,753 |
| Licence | Commercial licence needed |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| XTTS-v2 | — | BF16 | — | — | Weights ↗ |
Using it via the API
Once AxForge deploys xtts for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (xtts below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \ -H "Authorization: Bearer $AXFORGE_API_KEY" \ -F model="xtts" -F file=@audio.mp3
Details
Tags
Licence
The weights are open but its licence needs a commercial agreement for business use. AxForge can arrange that licence and host the model for you — you pay AxForge, we settle with the model’s maker. Ask us for a quote. Read the licence ↗