Model reference · open weights
wav2vec2-large-xlsr-53-l2-arctic-phoneme is an open-weight audio or speech model from mrrubino. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Released by | mrrubino |
|---|---|
| Type | Audio & music |
| Task | Speech→text |
| Runs with | transformers |
| Released | 2024-01-09 |
| Popularity | 1k downloads / month |
| Licence | Open weights |
About
This model is Wav2Vec2-Large-XLSR-53 fine-tuned on the manually annotated subset of CMU's L2-Arctic dataset. It was fine-tuned to perform automatic phonetic transcriptions in IPA. It was tuned following a similar procedure as described by vitouphy with the TIMIT dataset.
To use the model, create a pipeline and invoke it with the path to your WAV, which must be sampled at 16KHz.
from transformers import pipeline
pipe = pipeline(model="mrrubino/wav2vec2-large-xlsr-53-l2-arctic-phoneme")
transcription = pipe("file.wav")["text"]
The manually annotated subset of L2-Arctic was divided into training and testing datasets with a 90/10 split. The performance metrics for the testing dataset are included below.
WER - 0.425
CER - 0.128
If you find our model helpful, please feel free to cite us.
@article{Bo_Rubino_Xu_2024,
title={A Mispronunciation-Based Voice-Omics Representation Framework for Screening Specific Language Impairments in Children},
DOI={10.1109/ichi61247.2024.00045},
journal={2024 IEEE 12th International Conference on Healthcare Informatics (ICHI)},
author={Bo, Wei and Rubino, Matthew and Xu, Wenyao},
year={2024},
month={Jun},
pages={294–304}
}
From the published model card. Full card on the HuggingFace links in the sidebar.
Using it via the API
Once AxForge deploys wav2vec2-large-xlsr-53-l2-arctic-phoneme for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (wav2vec2-large-xlsr-53-l2-arctic-phoneme below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \ -H "Authorization: Bearer $AXFORGE_API_KEY" \ -F model="wav2vec2-large-xlsr-53-l2-arctic-phoneme" -F file=@audio.mp3
Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.