Model reference · open weights

granite-4.1

granite-4.1 is an open-weight language model from ibm-granite, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.

LLMs ibm-granite 5 variants 1.3M downloads/mo
Request this model on EU hardware All served models Not on the shared API today — deployed on request.

About

What granite-4.1 is

[](https://mot.isitopen.ai/model/1160) Granite-4.1-8B Model Summary: Granite-4.1-8B is a 8B parameter long-context instruct model finetuned from Granite-4.1-8B-Base using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets. Granite 4.1 models have gone through an improved post-training pipeline, including supervised finetuning and reinforcement learning alignment, resulting in enhanced tool calling, instruction following, and chat capabilities. - Developers: Granite Team, IBM - HF Collection: Granite 4.1 Language Models HF Collection - Technical Blog: Granite-4.1 Blog - GitHub Repository: ibm-granite/granite-4.1-language-models - Website: Granite Docs - Release Date: April 29th, 2026 - License: Apache 2.0 Supported Languages: English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. Users may finetune Granite 4.1 models for languages beyond these languages. Intended use: The model is designed to follow general instructions and can serve as the foundation for AI assistants across diverse domains, including business applications, as well as for LLM agents equipped with tool-use capabilities. Capabilities Summarization Text classification Text extraction Question-answering Retrieval Augmented Generation (RAG) Code related tasks Function-calling tasks Multilingual dialog use cases Fill-In-the-Middle (FIM) code completions -- Generation: This is a simple example of how to use Granite-4.1-8B model. Install the following libraries: Then, copy the snippet from the section that is relevant for your use case. Expected output: Tool-calling: Granite-4.1-8B comes with enhanced tool calling capabilities, enabling seamless integration with external functions and APIs. To define a list of tools please follow OpenAI's function definition schema. This is an example of how to use Granite-4.1-8B model tool-calling ability: Expected output: Coming soon -- Evaluation Results: General Tasks Alignment Tasks Math Tasks Code Tasks Tool Calling Tasks Multilingual Tasks Safety Model Architecture: Granite-4.1-8B baseline is built on a decoder-only dense transformer architectur

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

Makeribm-granite
TypeLanguage models
Parameters (lead)8.8B
Context128k tokens
Variants5
Runs withtransformers
Released2026-04-06
Popularity1.3M downloads / month
Likes254
LicenceOpen weights

How it works

How language models work

Your prompttext / messagesTransformerattention over tokensNext-token loopgenerate + streamResponsetext · tool callsA language model reads your tokens and predicts the next one, again and again, streaming the reply back.

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

VariantParamsPrecisionVRAMFits 16 GBWeights
granite-4.1-8b8.8BBF16~20.2 GBWeights ↗
granite-4.1-30b28.9BBF16~66.4 GBWeights ↗
granite-4.1-3b3.4BBF16~7.8 GBWeights ↗
granite-4.1-8b-fp88.8BFP8~10.1 GBWeights ↗
granite-4.1-3b-GGUFGGUFWeights ↗

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys granite-4-1 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (granite-4-1 below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"granite-4-1","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Tags

transformers safetensors granite text-generation language granite-4.1 conversational eval-results endpoints_compatible deploy:azure gguf compressed-tensors

Papers

Licence

Open weights

Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗

Sources

Weights & code

Want granite-4.1 on EU-owned hardware?

Request this model on EU hardware See what’s served now

Explore

More language models

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms