Model reference · open weights

granite-4.2-mxfp4

granite-4.2-mxfp4 is an open-weight language model from ibm-granite, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.

LLMs ibm-granite 3 variants 369 downloads/mo
Request this model on EU hardware All served models Not on the shared API today — deployed on request.

About

What granite-4.2-mxfp4 is

Granite-4.2-8B (MXFP4) [!NOTE] This repository contains the MXFP4 version of Granite-4.2-8B. Please refer to the original model's model card for additional details: https://huggingface.co/ibm-granite/granite-4.2-8b

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

Makeribm-granite
TypeLanguage models
Parameters (lead)5.1B
Context128k tokens
Variants3
Runs withtransformers
Based onibm-granite/granite-4.2-8b
Released2026-08-13
Popularity369 downloads / month
Likes2
LicenceOpen weights

How it works

How language models work

Your prompttext / messagesTransformerattention over tokensNext-token loopgenerate + streamResponsetext · tool callsA language model reads your tokens and predicts the next one, again and again, streaming the reply back.

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

VariantParamsPrecisionVRAMFits 16 GBWeights
granite-4.2-8b-mxfp45.1BBF16~11.6 GBWeights ↗
granite-4.2-30b-mxfp415.9BBF16~36.7 GBWeights ↗
granite-4.2-3b-mxfp43.7BBF16~8.4 GBWeights ↗

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys granite-4-2-mxfp4 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (granite-4-2-mxfp4 below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"granite-4-2-mxfp4","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Tags

transformers safetensors granite text-generation language granite-4.2 mxfp4 conversational endpoints_compatible 8-bit compressed-tensors

Licence

Open weights

Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗

Sources

Weights & code

Want granite-4.2-mxfp4 on EU-owned hardware?

Request this model on EU hardware See what’s served now

Explore

More language models

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms