Model reference · open weights
acestep-captioner is an open-weight audio or speech model from ACE-Step. acestep-captioner (BF16) weighs 22.4 GB; the smallest configuration that runs it is RTX 5090 32 GB.
Summary of the ACE-Step/acestep-captioner model card, 2026-10-01
What it is
| Released by | ACE-Step |
|---|---|
| Released | 2026-01-23 |
| Parameters | 10.7B |
| VRAM | 22.4 GB for the weights |
What it runs on
| Card | One stream | Memory |
|---|---|---|
| RTX 3060 12 GB … RTX 4090 24 GB | does not fit | |
| RTX 5090 32 GB | fits | 31.0 GB |
| L40S 48 GB | fits | 44.0 GB |
| A100 80 GB | fits | 78.2 GB |
| H100 80 GB | fits | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | fits | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | fits | 107 GB |
| H200 141 GB | fits | 138 GB |
| B200 180 GB | fits | 176 GB |
From the model card
ACE-Step Captioner is the annotation model used by ACE-Step v1.5 for training data labeling. It is a professional-grade music captioning model that generates detailed, structured descriptions of audio content.
🏆 Accuracy surpasses Gemini Pro 2.5 in music description tasks
The usage is the same as Qwen2.5 Omni-7B.
Use the following prompt to caption audio:
*Task* Describe this audio in detail
The model generates natural language descriptions covering multiple aspects of the music.
A melancholic indie folk track featuring fingerpicked acoustic guitar
as the primary instrument. The song opens with a sparse, contemplative
intro before the vocals enter with a breathy, intimate delivery.
The arrangement gradually builds through the verse, adding subtle
string pads and a gentle kick drum. The chorus lifts with layered
harmonies and a warmer, fuller texture. The bridge introduces a
key change and emotional climax before returning to the stripped-down
acoustic arrangement for the outro.
| Category | Styles |
|---|---|
| Electronic | Ambient, Techno, House, Drum & Bass, Synthwave, IDM, Downtempo |
| Rock | Alternative, Indie, Post-Rock, Progressive, Psychedelic, Grunge |
| Pop | Synth-pop, Electropop, Dream Pop, Art Pop, Indie Pop |
| Classical | Orchestral, Chamber, Minimalist, Neo-Classical, Cinematic |
| World | Latin, African, Middle Eastern, Asian Traditional, Celtic |
| Jazz | Fusion, Smooth, Bebop, Modal, Free Jazz |
| Hip-Hop | Trap, Boom Bap, Lo-fi, Instrumental, Cloud Rap |
| Category | Examples |
|---|---|
| Strings | Acoustic Guitar, Electric Guitar, Violin, Cello, Bass, Harp, Mandolin |
| Keys | Piano, Synthesizer, Organ, Rhodes, Wurlitzer, Mellotron |
| Percussion | Drums, Electronic Drums, Congas, Bongos, Timpani, Vibraphone |
| Wind | Saxophone, Trumpet, Flute, Clarinet, Oboe, French Horn |
| Electronic | Synth Bass, Pad, Lead, Arpeggiator, Sampler, 808, 303 |
| Dimension | Descriptors |
|---|---|
| Texture | Warm, Bright, Dark, Crisp, Muddy, Clean, Distorted, Saturated |
| Space | Reverberant, Dry, Spacious, Intimate, Cavernous, Tight |
| Dynamics | Punchy, Soft, Aggressive, Gentle, Compressed, Dynamic |
| Character | Ethereal, Gritty, Smooth, Raw, Polished, Organic, Synthetic |
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.
Running it yourself
Rent a machine by the hour. How to run this model is on its model card.