Model reference · open weights

LongCat-AudioDiT

Audio drbaph · community Text→speech 1 build Open weights 5k dl/mo

LongCat-AudioDiT is an open-weight audio or speech model from drbaph. LongCat-AudioDiT-3.5B-bf16 (BF16) weighs 7.7 GB; the smallest configuration that runs it is RTX 3060 12 GB.

What it is

Released bydrbaph
TypeAudio & music
TaskText→speech
Parameters (lead)3.8B
Runs withtransformers
Released2026-03-30
Popularity5k downloads / month
Weights7.7 GB (LongCat-AudioDiT-3.5B-bf16 (BF16), file size)
LicenceOpen weights

What it runs on

Memory and cards for LongCat-AudioDiT-3.5B-bf16 (BF16)

Weights 7.7 GB (file size) · overhead about 1.6 GB.

CardOne streamCounted
memory
RTX 3060 12 GBfits11.6 GB
RTX 4060 Ti 16 GBfits15.4 GB
RTX 3090 24 GBfits23.4 GB
RTX 4090 24 GBfits23.4 GB
RTX 5090 32 GBfits31.0 GB
L40S 48 GBfits44.0 GB
A100 80 GBfits78.2 GB
H100 80 GBfits78.1 GB
RTX PRO 6000 Blackwell 96 GBfits93.8 GB
DGX Spark (GB10) 128 GB unifiedfits107 GB
H200 141 GBfits138 GB
B200 180 GBfits176 GB

Estimates, not measurements: the weights are the build's file size. A speech model's decoder keeps a small cache for every stream it transcribes, so memory grows with the streams and beams at once. Counted memory is 92 % of what CUDA reports for the card.

From the model card

What drbaph says about LongCat-AudioDiT

Read the full model card

What is this?

This is a BF16 conversion of LongCat-AudioDiT-3.5B — a state-of-the-art diffusion-based zero-shot TTS model by Meituan that operates directly in the waveform latent space. Converting from FP32 to BF16 halves the on-disk size and VRAM usage with negligible quality loss, making it the recommended variant for most users.

Original (3.5B FP32)This (3.5B BF16)
Weight dtypefloat32bfloat16
Activation dtypefloat32bfloat16
File size~14 GB~7 GB
VRAM (inference)~20 GB~12 GB
QualityReferenceVirtually identical
Extra dependenciesnonenone

Conversion Details

All model weights — DiT transformer backbone, Wav-VAE, and text encoder — are converted from float32 to bfloat16. BF16 preserves the same dynamic range as FP32 (8 exponent bits) while halving memory usage, making it the lossless practical choice for inference on modern GPUs.

No post-training quantization, calibration data, or scale factors are required. The model is a direct dtype cast and is fully compatible with the original audiodit inference code.


Hardware Requirements

  • GPU: NVIDIA GPU with CUDA support (BF16 supported on Ampere and newer; falls back gracefully on older hardware)
  • VRAM: ~7 GB
  • CPU: Supported but slow

Usage — ComfyUI (Recommended)

The easiest way to use this model is with ComfyUI-LongCat-AudioDIT-TTS, which has native support for this BF16 model with zero extra setup.

Installation

  1. Install the ComfyUI node via ComfyUI Manager (search LongCat-AudioDiT) or manually:
   cd ComfyUI/custom_nodes
   git clone https://github.com/Saganaki22/ComfyUI-LongCat-AudioDIT-TTS.git
  1. The model auto-downloads on first use — select LongCat-AudioDiT-3.5B-bf16 from the model dropdown in any LongCat node.

  2. Or download manually:

   huggingface-cli download drbaph/LongCat-AudioDiT-3.5B-bf16 --local-dir ComfyUI/models/audiodit/LongCat-AudioDiT-3.5B-bf16

Available Nodes

  • LongCat AudioDiT TTS — Zero-shot text-to-speech
  • LongCat AudioDiT Voice Clone TTS — Voice cloning from reference audio
  • LongCat AudioDiT Multi-Speaker TTS — Multi-speaker conversation synthesis

Recommended Settings

  • dtype: auto or bf16 — matches this model's native dtype
  • guidance_method: cfg for TTS, apg for voice cloning
  • steps: 16 (balanced), 32 (higher quality)
  • keep_model_loaded: True for repeated use

This is the recommended variant for most users — best balance of quality, VRAM usage, and compatibility.


About LongCat-AudioDiT

LongCat-AudioDiT is a non-autoregressive diffusion-based TTS model from Meituan that achieves state-of-the-art zero-shot voice cloning performance on the Seed benchmark. Unlike previous methods relying on mel-spectrograms, it operates directly in the waveform latent space using only a Wav-VAE and a DiT backbone.

The 3.5B variant achieves 0.818 SIM on Seed-ZH and 0.797 SIM on Seed-Hard, surpassing both open-source and closed-source competitors.


License

This model inherits the MIT License from meituan-longcat/LongCat-AudioDiT-3.5B.

The BF16 conversion was produced by drbaph and is released under the same license.

Quoted from the model card on Hugging Face — the full card is behind the Hugging Face link above.

How it works

How audio & music work

Audio or textinputAudio modelrecognise / synthesiseText or audiooutputSpeech-to-text turns audio into text; text-to-speech and music models turn text into audio.
© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms