Model reference · open weights
stable-audio-3-optimized is an open-weight audio or speech model from stabilityai, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
Stable Audio 3 Optimized Note: This repository contains experimental checkpoints optimised for acceleration on specific hardware. For standard checkpoints, please use Stable Audio 3 Medium instead. Please note: For commercial use, please refer to https://stability.ai/license Model Description Stable Audio 3 is a family of fast latent diffusion models (small, medium, large) for variable length audio generation and editing. Since our models can generate several minutes of audio, variable-length generations are key to avoid the cost of producing full-length generations for short sounds. We also support inpainting, enabling targeted audio editing and the continuation of short recordings. Our latent diffusion models operate on top of a novel semantic-acoustic autoencoder that projects audio into a compact latent space, enabling efficient diffusion-based generation while preserving audio fidelity and encouraging semantic structure in the latent. Finally, we run adversarial post-training to both accelerate inference and improve generation quality, reducing the number of inference steps while improving fidelity and prompt adherence. Stable Audio 3 models are trained on licensed and Creative Commons data to generate music and sounds in less than a 2s on an H200 GPU and less than a few seconds on a MacBook Pro M4. We release the weights of small and medium, that can run on consumer-grade hardware, together with their training and inference pipeline. Usage This model can be used with: 1. the stable-audio-3 inference and fine-tuning library 2. the stable-audio-tools research library Using with stable-audio-3 Using with stable-audio-tools Model Details Model type: Stable Audio 3 is a latent diffusion model based on a transformer architecture. Language(s): English License: Stability AI Community License. Research Paper: https://arxiv.org/abs/2605.17991 We use a publicly available pre-trained T5Gemma model (t5gemma-b-b-ul2) for text conditioning. T5Gemma is redistributed under the Gemma Terms of Use. Training dataset Datasets Used Our dataset consists of 1,278,902 audio recordings, where 806,284 recordings are licensed from AudioSparx and a further 472,618 are from Freesound.
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | stabilityai |
|---|---|
| Type | Audio & music |
| Variants | 1 |
| Runs with | stable-audio-3 |
| Released | 2026-05-18 |
| Popularity | 13k downloads / month |
| Likes | 39 |
| Licence | Commercial licence needed |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| stable-audio-3-optimized | — | BF16 | — | — | Weights ↗ |
Using it via the API
Once AxForge deploys stable-audio-3-optimized for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (stable-audio-3-optimized below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \ -H "Authorization: Bearer $AXFORGE_API_KEY" \ -F model="stable-audio-3-optimized" -F file=@audio.mp3
Licence
The weights are open but its licence needs a commercial agreement for business use. AxForge can arrange that licence and host the model for you — you pay AxForge, we settle with the model’s maker. Ask us for a quote. Read the licence ↗