granite-speech-4.1-plus

About

What granite-speech-4.1-plus is

Granite-Speech-4.1-2B-Plus Model Summary Granite-Speech-4.1-2B-Plus has similar capabilities to the Granite-Speech-4.1-2B model. The plus model adds two new community-requested rich transcription features that can be activated with a simple prompt change: speaker-attributed ASR (speaker labels and word transcripts) and word-level timing information. Unlike the base mode, the plus model doesn't provide punctuation and capitalization. The model was trained on corpora similar to the Granite-Speech-4.1-2B model which were augmented with speaker turns and word-level timestamp tags. This allows the model to provide different modes of functionality controlled by different prompts. Two additional model variants explore different capabilities and inference optimization: - Granite-Speech-4.1-2B for applications where accuracy is the primary concern with support for punctuated, capitalized transcripts, AST and keyword-biased recognition, and includes Japanese. - Granite-Speech-4.1-2B-NAR introduces a novel non-autoregressive architecture for higher throughput ASR only mode In this mode the model generates only the text transcript similar to the Granite-Speech-4.1-2B model. Speaker attributed ASR (SAA) In this mode, the model adds speaker tags in the format of [Speaker N]: where $N$ is the speaker number, before each speaker turn. The speakers are numbered by their order of appearance so the first speaker will always be marked with [Speaker 1]: and the second with [Speaker 2]:, etc. For example: "[Speaker 1]: Hello how are you [Speaker 2]: I'm fine and how are you feeling [Speaker 1]: I feel wonderful". See Resources for more information about SAA. Word-level timestamps In this mode, the model adds timestamp tags after each word indicating the end of the word in the audio. Silences are transcribed as and a timestamp tag also indicates their end. The format of the tag is [T:N] where $N$ is an integer number indicating the time in centiseconds (1/100th of a second). To reduce the amount of generated tokens, only the last three digits of $N$ are provided. This causes a rollover after 10 seconds. The conversion from time $t$ in seconds to timestamp is $N = round(t100) \mod 1000

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

How it works

How audio & music work

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys granite-speech-4-1-plus for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (granite-speech-4-1-plus below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -F model="granite-speech-4-1-plus" -F file=@audio.mp3

Details

Languages, data & research

Papers

Licence

Open weights

Sources

Weights & code

Explore

More audio & music