Model reference · open weights

ACE-Step

Audio ACE-Step Music / audio 1 build Open weights 0 dl/mo

ACE-Step is an open-weight audio or speech model from ACE-Step. ACE-Step-v1-3.5B (BF16) weighs 8.3 GB; the smallest configuration that runs it is RTX 3060 12 GB.

  • ACE-Step is an open-source foundation model for text-to-audio music generation, developed by ACE Studio and StepFun.
  • It integrates diffusion-based generation with a Deep Compression AutoEncoder and a lightweight linear transformer to produce full songs with duration control.
  • The model supports English, Chinese, German, French, Spanish, Italian, Portuguese, Polish, and other languages, and is released under the Apache 2.0 license.

Summary of the ACE-Step/ACE-Step-v1-3.5B model card, 2026-10-01

What it is

Released byACE-Step
Released2025-04-28
VRAM8.3 GB for the weights

What it runs on

Memory and cards for ACE-Step-v1-3.5B (BF16)

8.3 GBweights, file size
1.6 GBruntime overhead
CardOne streamMemory
RTX 3060 12 GBfits11.6 GB
RTX 4060 Ti 16 GBfits15.4 GB
RTX 3090 24 GBfits23.4 GB
RTX 4090 24 GBfits23.4 GB
RTX 5090 32 GBfits31.0 GB
L40S 48 GBfits44.0 GB
A100 80 GBfits78.2 GB
H100 80 GBfits78.1 GB
RTX PRO 6000 Blackwell 96 GBfits93.8 GB
DGX Spark (GB10) 128 GB unifiedfits107 GB
H200 141 GBfits138 GB
B200 180 GBfits176 GB

From the model card

What ACE-Step says about ACE-Step

Read the model card

Model Description

ACE-Step is a novel open-source foundation model for music generation that overcomes key limitations of existing approaches through a holistic architectural design. It integrates diffusion-based generation with Sana's Deep Compression AutoEncoder (DCAE) and a lightweight linear transformer, achieving state-of-the-art performance in generation speed, musical coherence, and controllability.

Key Features:

  • 15× faster than LLM-based baselines (20s for 4-minute music on A100)
  • Superior musical coherence across melody, harmony, and rhythm
  • full-song generation, duration control and accepts natural language descriptions

Uses

Direct Use

ACE-Step can be used for:

  • Generating original music from text descriptions
  • Music remixing and style transfer
  • edit song lyrics

Downstream Use

The model serves as a foundation for:

  • Voice cloning applications
  • Specialized music generation (rap, jazz, etc.)
  • Music production tools
  • Creative AI assistants

Out-of-Scope Use

The model should not be used for:

  • Generating copyrighted content without permission
  • Creating harmful or offensive content
  • Misrepresenting AI-generated music as human-created

How to Get Started

see: https://github.com/ace-step/ACE-Step

Hardware Performance

Device27 Steps60 Steps
NVIDIA A10027.27x12.27x
RTX 409034.48x15.63x
RTX 309012.76x6.48x
M2 Max2.27x1.03x

RTF (Real-Time Factor) shown - higher values indicate faster generation

Limitations

  • Performance varies by language (top 10 languages perform best)
  • Longer generations (>5 minutes) may lose structural coherence
  • Rare instruments may not render perfectly
  • Output Inconsistency: Highly sensitive to random seeds and input duration, leading to varied "gacha-style" results.
  • Style-specific Weaknesses: Underperforms on certain genres (e.g. Chinese rap/zh_rap) Limited style adherence and musicality ceiling
  • Continuity Artifacts: Unnatural transitions in repainting/extend operations
  • Vocal Quality: Coarse vocal synthesis lacking nuance
  • Control Granularity: Needs finer-grained musical parameter control

Ethical Considerations

Users should:

  • Verify originality of generated works
  • Disclose AI involvement
  • Respect cultural elements and copyrights
  • Avoid harmful content generation

Model Details

Developed by: ACE Studio and StepFun Model type: Diffusion-based music generation with transformer conditioning License: Apache 2.0 Resources:

Citation

@misc{gong2025acestep,
  title={ACE-Step: A Step Towards Music Generation Foundation Model},
  author={Junmin Gong, Wenxiao Zhao, Sen Wang, Shengyuan Xu, Jing Guo},
  howpublished={\url{https://github.com/ace-step/ACE-Step}},
  year={2025},
  note={GitHub repository}
}

Acknowledgements

This project is co-led by ACE Studio and StepFun.

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

Running it yourself

Run it on a rented GPU

Rent a machine by the hour. ComfyUI is installed on it. Open ComfyUI through the tunnel, then Templates → ACE Step v1 Text to Song: it loads ComfyUI's own build of this model, the files above.

# on your rented machine (the ssh line is on its page in the console)
# get REPO FILE FOLDER: one file into /workspace/models/FOLDER, where ComfyUI loads it from
get() { hf download "$1" "$2" --local-dir /workspace/hf-files && mkdir -p "/workspace/models/$3" && mv "/workspace/hf-files/$2" "/workspace/models/$3/$4"; }

# the files of the template “ACE Step v1 Text to Song” (7.2 GB)
get Comfy-Org/ACE-Step_ComfyUI_repackaged all_in_one/ace_step_v1_3.5b.safetensors checkpoints

start-comfyui
Renting a GPU: connect, tunnels, ComfyUI
# on your computer, in a second terminal: ComfyUI in your browser at http://localhost:8188
# HOST and PORT are your machine's, from its page in the console
ssh -L 8188:localhost:8188 dev@HOST -p PORT
© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms