Model reference · open weights
faster-distil-whisper-small.en is an open-weight audio or speech model from Systran. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Maker | Systran |
|---|---|
| Type | Audio & music |
| Task | Speech→text |
| Runs with | ctranslate2 |
| Released | 2024-01-19 |
| Popularity | 7k downloads / month |
| Licence | Open weights |
About
This repository contains the conversion of distil-whisper/distil-small.en to the CTranslate2 model format.
This model can be used in CTranslate2 or projects based on CTranslate2 such as faster-whisper.
from faster_whisper import WhisperModel
model = WhisperModel("distil-small.en")
segments, info = model.transcribe("audio.mp3")
for segment in segments:
print("[%.2fs -> %.2fs] %s" % (segment.start, segment.end, segment.text))
The original model was converted with the following command:
ct2-transformers-converter --model distil-whisper/distil-small.en --output_dir faster-distil-whisper-small.en \
--copy_files tokenizer.json preprocessor_config.json --quantization float16
Note that the model weights are saved in FP16. This type can be changed when the model is loaded using the compute_type option in CTranslate2.
For more information about the original model, see its model card.
From the published model card. Full card on the HuggingFace links in the sidebar.
How it works
Using it via the API
Once AxForge deploys faster-distil-whisper-small-en for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (faster-distil-whisper-small-en below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \ -H "Authorization: Bearer $AXFORGE_API_KEY" \ -F model="faster-distil-whisper-small-en" -F file=@audio.mp3
Create an account — your API key is available in the console. 5M tokens/month currently included with every new account at launch.