Model reference · open weights
tts-hifigan-libritts-22050Hz is an open-weight audio or speech model from speechbrain, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
Vocoder with HiFIGAN trained on LibriTTS This repository provides all the necessary tools for using a HiFIGAN vocoder trained with LibriTTS (with multiple speakers). The sample rate used for the vocoder is 22050 Hz. The pre-trained model takes in input a spectrogram and produces a waveform in output. Typically, a vocoder is used after a TTS model that converts an input text into a spectrogram. Alternatives to this models are the following: - tts-hifigan-libritts-16kHz (same model trained on the same dataset, but for a sample rate of 16000 Hz) - tts-hifigan-ljspeech (same model trained on LJSpeech for a sample rate of 22050 Hz). Install SpeechBrain Please notice that we encourage you to read our tutorials and learn more about SpeechBrain. Using the Vocoder - Basic Usage: - Spectrogram to Waveform Conversion: Using the Vocoder with the TTS Inference on GPU To perform inference on the GPU, add runopts={"device":"cuda"} when calling the fromhparams method. Training The model was trained with SpeechBrain. To train it from scratch follow these steps: 1. Clone SpeechBrain: 2. Install it: 3. Run Training: To change the sample rate for model training go to the "recipes/LibriTTS/vocoder/hifigan/hparams/train.yaml" file and change the value for samplerate as required. The training logs and checkpoints are available here.
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | speechbrain |
|---|---|
| Type | Audio & music |
| Variants | 1 |
| Runs with | speechbrain |
| Released | 2022-10-26 |
| Popularity | 281k downloads / month |
| Likes | 6 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| tts-hifigan-libritts-22050Hz | — | BF16 | — | — | Weights ↗ |
Using it via the API
Once AxForge deploys tts-hifigan-libritts-22050hz for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (tts-hifigan-libritts-22050hz below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \ -H "Authorization: Bearer $AXFORGE_API_KEY" \ -F model="tts-hifigan-libritts-22050hz" -F file=@audio.mp3
Licence
Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗