Model reference · open weights
wav2vec2-large-robust-ft-libritts-voxpopuli is an open-weight audio or speech model from jbetker. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Released by | jbetker |
|---|---|
| Type | Audio & music |
| Task | Speech→text |
| Runs with | transformers |
| Released | 2022-03-02 |
| Popularity | 8k downloads / month |
| Licence | Unknown |
About
This checkpoint is a wav2vec2-large model that is useful for generating transcriptions with punctuation. It is intended for use in building transcriptions for TTS models, where punctuation is very important for prosody.
This model was created by fine-tuning the facebook/wav2vec2-large-robust-ft-libri-960h checkpoint on the libritts and voxpopuli datasets with a new vocabulary that includes punctuation.
The model gets a respectable WER of 4.45% on the librispeech validation set. The baseline, facebook/wav2vec2-large-robust-ft-libri-960h, got 4.3%.
Since the model was fine-tuned on clean audio, it is not well-suited for noisy audio like CommonVoice (though I may upload a checkpoint for that soon too). It still does pretty good, though.
The vocabulary is uploaded to the model hub as well jbetker/tacotron_symbols.
Check out my speech transcription script repo, ocotillo for usage examples: https://github.com/neonbjb/ocotillo
From the published model card. Full card on the HuggingFace links in the sidebar.
Using it via the API
Once AxForge deploys wav2vec2-large-robust-ft-libritts-voxpopuli for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (wav2vec2-large-robust-ft-libritts-voxpopuli below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \ -H "Authorization: Bearer $AXFORGE_API_KEY" \ -F model="wav2vec2-large-robust-ft-libritts-voxpopuli" -F file=@audio.mp3
Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.