magenta-realtime-2

About

What magenta-realtime-2 is

Model Card for Magenta RealTime 2 Authors: Google DeepMind Resources: - Get Started - Blog Post - Repository - HuggingFace Terms of Use Magenta RealTime 2 is offered under a combination of licenses: the codebase is licensed under Apache 2.0, and the model weights under Creative Commons Attribution 4.0 International. In addition, we specify the following usage terms: Copyright 2026 Google LLC Use these materials responsibly and do not generate content, including outputs, that infringe or violate the rights of others, including rights in copyrighted content. Google claims no rights in outputs you generate using Magenta RealTime 2. You and your users are solely responsible for outputs and their subsequent uses. Unless required by applicable law or agreed to in writing, all software and materials distributed here under the Apache 2.0 or CC-BY licenses are distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the licenses for the specific language governing permissions and limitations under those licenses. You are solely responsible for determining the appropriateness of using, reproducing, modifying, performing, displaying or distributing the software and materials, and any outputs, and assume any and all risks associated with your use or distribution of any of the software and materials, and any outputs, and your exercise of rights and permissions under the licenses. Model Details Magenta RealTime 2 is an open music generation model from Google built for on device streaming generation with low-latency control. It is a live music model and a follow up to the prior Magenta RealTime model and Lyria RealTime API, offering on-device generation with richer control and lower latency. Magenta RealTime 2 enables the continuous generation of musical audio steered by text prompts, audio examples, and MIDI. System Components Magenta RealTime 2 is composed of three components: SpectroStream, MusicCoCa, and an LLM. The structure is similar to that of the original Magenta RealTime, detailed here. The primary difference is the LLM, which is now a Decoder-only model supporting frame-wise autoregression (rather than chunk-wise)

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

How it works

How audio & music work

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys magenta-realtime-2 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (magenta-realtime-2 below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -F model="magenta-realtime-2" -F file=@audio.mp3

Details

Languages, data & research

Papers

Licence

Open weights

Sources

Weights & code

Explore

More audio & music