Model reference · open weights
LFM2.5-Audio-JP is an open-weight audio or speech model from LiquidAI. LFM2.5-Audio-1.5B-JP (BF16) weighs 3.3 GB; the smallest configuration that runs it is RTX 3060 12 GB.
Summary of the LiquidAI/LFM2.5-Audio-1.5B-JP-GGUF model card, 2026-10-01. The estimate below is for another build of the family.
What it is
| Released by | LiquidAI |
|---|---|
| Released | 2026-05-27 |
| VRAM | 3.3 GB for the weights |
What it runs on
| Card | One stream | Memory |
|---|---|---|
| RTX 3060 12 GB | fits | 11.6 GB |
| RTX 4060 Ti 16 GB | fits | 15.4 GB |
| RTX 3090 24 GB | fits | 23.4 GB |
| RTX 4090 24 GB | fits | 23.4 GB |
| RTX 5090 32 GB | fits | 31.0 GB |
| L40S 48 GB | fits | 44.0 GB |
| A100 80 GB | fits | 78.2 GB |
| H100 80 GB | fits | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | fits | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | fits | 107 GB |
| H200 141 GB | fits | 138 GB |
| B200 180 GB | fits | 176 GB |
Builds
| Build | Params | Precision | Weights | Smallest setup |
|---|---|---|---|---|
| LFM2.5-Audio-1.5B-JP-GGUF ↗ 4 builds: Q4_0 853 MB … F32 5.7 GB |
— | GGUF | 2.9 GB | RTX 3060 12 GB |
| LFM2.5-Audio-1.5B-JP (above) ↗ | 1.5B | BF16 | 3.3 GB | RTX 3060 12 GB |
From the model card
src="https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png" alt="Liquid AI" style="width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;" />
This repository contains GGUF quantizations of LiquidAI/LFM2.5-Audio-1.5B-JP for use with llama.cpp.
| File | Quantization | Size |
|---|---|---|
LFM2.5-Audio-1.5B-JP-F32.gguf | F32 (language model) | 4.4 GB |
LFM2.5-Audio-1.5B-JP-F16.gguf | F16 (language model) | 2.2 GB |
LFM2.5-Audio-1.5B-JP-Q8_0.gguf | Q8_0 (language model) | 1.2 GB |
LFM2.5-Audio-1.5B-JP-Q4_0.gguf | Q4_0 (language model) | 664 MB |
mmproj-LFM2.5-Audio-1.5B-JP-F32.gguf | F32 (audio encoder / multimodal projector) | 695 MB |
mmproj-LFM2.5-Audio-1.5B-JP-F16.gguf | F16 (audio encoder / multimodal projector) | 413 MB |
mmproj-LFM2.5-Audio-1.5B-JP-Q8_0.gguf | Q8_0 (audio encoder / multimodal projector) | 280 MB |
mmproj-LFM2.5-Audio-1.5B-JP-Q4_0.gguf | Q4_0 (audio encoder / multimodal projector) | 210 MB |
vocoder-LFM2.5-Audio-1.5B-JP-F32.gguf | F32 (vocoder / audio detokenizer) | 739 MB |
vocoder-LFM2.5-Audio-1.5B-JP-F16.gguf | F16 (vocoder / audio detokenizer) | 370 MB |
vocoder-LFM2.5-Audio-1.5B-JP-Q8_0.gguf | Q8_0 (vocoder / audio detokenizer) | 197 MB |
vocoder-LFM2.5-Audio-1.5B-JP-Q4_0.gguf | Q4_0 (vocoder / audio detokenizer) | 104 MB |
tokenizer-LFM2.5-Audio-1.5B-JP-F32.gguf | F32 (audio tokenizer) | 268 MB |
tokenizer-LFM2.5-Audio-1.5B-JP-F16.gguf | F16 (audio tokenizer) | 134 MB |
tokenizer-LFM2.5-Audio-1.5B-JP-Q8_0.gguf | Q8_0 (audio tokenizer) | 72 MB |
tokenizer-LFM2.5-Audio-1.5B-JP-Q4_0.gguf | Q4_0 (audio tokenizer) | 46 MB |
runners folder contains pre-built binaries for various architectures:
llama-liquid-audio-clillama-liquid-audio-serverSet env variables.
export CKPT=/path/to/LFM2.5-Audio-1.5B-JP-GGUF
export INPUT_WAV=/path/to/input.wav
export OUTPUT_WAV=/path/to/output.wav
./llama-liquid-audio-cli -m $CKPT/LFM2.5-Audio-1.5B-Q4_0.gguf -mm $CKPT/mmproj-LFM2.5-Audio-1.5B-Q4_0.gguf -mv $CKPT/vocoder-LFM2.5-Audio-1.5B-Q4_0.gguf --tts-speaker-file $CKPT/tokenizer-LFM2.5-Audio-1.5B-Q4_0.gguf -sys "Perform ASR in japanese." --audio $INPUT_WAV
./llama-liquid-audio-cli -m $CKPT/LFM2.5-Audio-1.5B-Q4_0.gguf -mm $CKPT/mmproj-LFM2.5-Audio-1.5B-Q4_0.gguf -mv $CKPT/vocoder-LFM2.5-Audio-1.5B-Q4_0.gguf --tts-speaker-file $CKPT/tokenizer-LFM2.5-Audio-1.5B-Q4_0.gguf -sys "Perform TTS in japanese." -p "こんにちは、お元気ですか?" --output $OUTPUT_WAV
./llama-liquid-audio-cli -m $CKPT/LFM2.5-Audio-1.5B-Q4_0.gguf -mm $CKPT/mmproj-LFM2.5-Audio-1.5B-Q4_0.gguf -mv $CKPT/vocoder-LFM2.5-Audio-1.5B-Q4_0.gguf --tts-speaker-file $CKPT/tokenizer-LFM2.5-Audio-1.5B-Q4_0.gguf -sys "Respond with interleaved text and audio." --audio $INPUT_WAV --output $OUTPUT_WAV
Start server
export CKPT=/path/to/LFM2.5-Audio-1.5B-JP-GGUF
./llama-liquid-audio-server -m $CKPT/LFM2.5-Audio-1.5B-Q4_0.gguf -mm $CKPT/mmproj-LFM2.5-Audio-1.5B-Q4_0.gguf -mv $CKPT/vocoder-LFM2.5-Audio-1.5B-Q4_0.gguf --tts-speaker-file $CKPT/tokenizer-LFM2.5-Audio-1.5B-Q4_0.gguf
Use liquid_audio_chat.py script to communicate with the server.
uv run liquid_audio_chat.py
Runners are built from https://github.com/ggml-org/llama.cpp/pull/18641.
The code in this repository and associated weights are licensed under the LFM Open License v1.0.
The code for the audio encoder is based on Nvidia NeMo, licensed under Apache 2.0, and the canary-180m-flash checkpoint, licensed under CC-BY 4.0. To simplify dependency resolution, we also ship the Python code of Kyutai Mimi, licensed under the MIT License. We also redistribute weights for Kyutai Mimi, licensed under CC-BY-4.0.
@article{liquidai2025lfm2,
title={LFM2 Technical Report},
author={Liquid AI},
journal={arXiv preprint arXiv:2511.23404},
year={2025}
}
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.
How it works