Model reference · open weights
faster-whisper-small is an open-weight audio or speech model from guillaumekln. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Released by | guillaumekln |
|---|---|
| Type | Audio & music |
| Task | Speech→text |
| Runs with | ctranslate2 |
| Released | 2023-03-23 |
| Popularity | 2k downloads / month |
| Licence | Open weights |
About
This repository contains the conversion of openai/whisper-small to the CTranslate2 model format.
This model can be used in CTranslate2 or projects based on CTranslate2 such as faster-whisper.
from faster_whisper import WhisperModel
model = WhisperModel("small")
segments, info = model.transcribe("audio.mp3")
for segment in segments:
print("[%.2fs -> %.2fs] %s" % (segment.start, segment.end, segment.text))
The original model was converted with the following command:
ct2-transformers-converter --model openai/whisper-small --output_dir faster-whisper-small \
--copy_files tokenizer.json --quantization float16
Note that the model weights are saved in FP16. This type can be changed when the model is loaded using the compute_type option in CTranslate2.
For more information about the original model, see its model card.
From the published model card. Full card on the HuggingFace links in the sidebar.
How it works
Using it via the API
Once AxForge deploys guillaumekln-faster-whisper-small for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (guillaumekln-faster-whisper-small below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \ -H "Authorization: Bearer $AXFORGE_API_KEY" \ -F model="guillaumekln-faster-whisper-small" -F file=@audio.mp3
Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.