Model reference · open weights

higgs-audio-tts-transformers

higgs-audio-tts-transformers is an open-weight audio or speech model from multimodalart, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.

Licence fee required Audio multimodalart 1 variants 44k downloads/mo
Request a licence + hosting quote All served models Not on the shared API today — deployed on request.

About

What higgs-audio-tts-transformers is

Higgs Audio v3 TTS (4B) — transformers trustremotecode port A trustremotecode packaging of bosonai/higgs-audio-v3-tts-4b that loads with plain 🤗 transformers (no SGLang). The weights are the original checkpoint, copied unchanged; only a small modeling.py / configuration.py pair and an automap were added. The model is a standard Qwen3-4B backbone plus a fused multi-codebook audio embedding/head. Reference-audio encoding and waveform decoding use the transformers-native bosonai/higgs-audio-v2-tokenizer (higgsaudiov2tokenizer), loaded automatically on first use. Requires transformers = 5.5. Usage generatespeech returns a mono 24 kHz waveform as a CPU float32 tensor [L]. Notes - Generation uses Higgs' delay pattern across 8 codebooks (vocab 1026, incl. BOC/EOC specials); de-delay + decode are handled internally. - The codec runs in fp32 (decode is unstable in bf16); the LM backbone runs in the dtype you load it in (bf16 recommended). - License: research/non-commercial, inherited from the upstream checkpoint — see LICENSE.

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

Makermultimodalart
TypeAudio & music
Parameters (lead)4.7B
Variants1
Runs withtransformers
Based onbosonai/higgs-audio-v3-tts-4b
Released2026-06-05
Popularity44k downloads / month
Likes20
LicenceCommercial licence needed

How it works

How audio & music work

Audio or textinputAudio modelrecognise / synthesiseText or audiooutputSpeech-to-text turns audio into text; text-to-speech and music models turn text into audio.

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

VariantParamsPrecisionVRAMFits 16 GBWeights
higgs-audio-v3-tts-4b-transformers4.7BBF16~10.7 GBWeights ↗

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys higgs-audio-tts-transformers for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (higgs-audio-tts-transformers below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -F model="higgs-audio-tts-transformers" -F file=@audio.mp3

Details

Languages, data & research

Languages

en

Tags

transformers safetensors higgs_multimodal_qwen3 feature-extraction text-to-speech tts voice-cloning higgs-audio qwen3 custom_code en

Licence

Commercial licence needed

The weights are open but its licence needs a commercial agreement for business use. AxForge can arrange that licence and host the model for you — you pay AxForge, we settle with the model’s maker. Ask us for a quote. Read the licence ↗

Sources

Weights & code

Want higgs-audio-tts-transformers on EU-owned hardware?

Request a licence + hosting quote See what’s served now

Explore

More audio & music

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms