Model reference · open weights

ace-step-1d-vae-stable-audio-format

Available as managed deployment Audio ACE-Step Music / audio 1 variants 0 dl/mo

ace-step-1d-vae-stable-audio-format is an open-weight audio or speech model from ACE-Step. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.

Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.

What it is

MakerACE-Step
TypeAudio & music
TaskMusic / audio
Runs withstable-audio-tools
Released2026-04-10
Popularity0 downloads / month
LicenceOpen weights

About

What ace-step-1d-vae-stable-audio-format is

Model Details

This is the 1D Variational Autoencoder (VAE) used in ACE-Step v1.5 for music generation. The weights are provided in stable-audio-tools compatible format, making it easy to load, fine-tune, and integrate into your own training pipelines.

  • Developed by: ACE-STEP
  • Model type: Audio VAE (Oobleck Autoencoder)
  • License: MIT
ParameterValue
ArchitectureOobleck Autoencoder (VAE)
Audio Channels2 (Stereo)
Sampling Rate48,000 Hz
Latent Dim64
Encoder Latent Dim128
Downsampling Ratio1,920
Encoder/Decoder Channels128
Channel Multipliers[1, 2, 4, 8, 16]
Strides[2, 4, 4, 6, 10]
ActivationSnake

🏗️ Architecture

The VAE is a core component of the ACE-Step v1.5 pipeline, responsible for compressing raw stereo audio (48kHz) into a compact latent representation with a 1920x downsampling ratio and 64-dimensional latent space. The DiT operates in this latent space to generate music.

Quick Start

Installation

pip install stable-audio-tools torchaudio

Load and Use

from stable_audio_vae import StableAudioVAE

# Load model
vae = StableAudioVAE(
    config_path="config.json",
    checkpoint_path="checkpoint.ckpt",
)
vae = vae.cuda().eval()

# Encode audio
wav = vae.load_wav("input.wav")
wav = wav.cuda()
latent = vae.encode(wav)
print(f"Latent shape: {latent.shape}")  # [batch, 64, time/1920]

# Decode back to audio
output = vae.decode(latent)

Command Line

python stable_audio_vae.py -i input.wav -o output.wav

# For long audio, use chunked processing
python stable_audio_vae.py -i input.wav -o output.wav --chunked

Fine-Tuning

This checkpoint is compatible with stable-audio-tools training pipelines. The config.json includes full training configuration (optimizer, loss, discriminator settings) that you can use as a starting point for fine-tuning.

File Structure

.
├── config.json            # Model architecture and training config
├── checkpoint.ckpt        # Model weights (PyTorch checkpoint)
├── stable_audio_vae.py    # Inference script with StableAudioVAE wrapper
└── README.md

🦁 Related Models

ModelDescriptionHugging Face
acestep-v15-baseDiT base model (CFG, 50 steps)Link
acestep-v15-sftDiT SFT model (CFG, 50 steps)Link
acestep-v15-turboDiT turbo model (8 steps)Link
acestep-v15-xl-baseXL DiT base (4B, CFG, 50 steps)Link
acestep-v15-xl-sftXL DiT SFT (4B, CFG, 50 steps)Link
acestep-v15-xl-turboXL DiT turbo (4B, 8 steps)Link

🙏 Acknowledgements

This project is co-led by ACE Studio and StepFun.

📖 Citation

If you find this project useful for your research, please consider citing:

@misc{gong2026acestep,
	title={ACE-Step 1.5: Pushing the Boundaries of Open-Source Music Generation},
	author={Junmin Gong, Yulin Song, Wenxiao Zhao, Sen Wang, Shengyuan Xu, Jing Guo},
	howpublished={\url{https://github.com/ace-step/ACE-Step-1.5}},
	year={2026},
	note={GitHub repository}
}

From the published model card. Full card on the HuggingFace links in the sidebar.

How it works

How audio & music work

Audio or textinputAudio modelrecognise / synthesiseText or audiooutputSpeech-to-text turns audio into text; text-to-speech and music models turn text into audio.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys ace-step-1d-vae-stable-audio-format for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (ace-step-1d-vae-stable-audio-format below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -F model="ace-step-1d-vae-stable-audio-format" -F file=@audio.mp3

Create an account — your API key is available in the console. 5M tokens/month currently included with every new account at launch.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms