Model reference · open weights

granite-4.0-h-tiny

granite-4.0-h-tiny is an open-weight language model from ibm-granite, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.

LLMs ibm-granite 1 variants 95k downloads/mo
Request this model on EU hardware All served models Not on the shared API today — deployed on request.

About

What granite-4.0-h-tiny is

[](https://mot.isitopen.ai/model/1161) Granite-4.0-H-Tiny 📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses. Model Summary: Granite-4.0-H-Tiny is a 7B parameter long-context instruct model finetuned from Granite-4.0-H-Tiny-Base using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets. This model is developed using a diverse set of techniques with a structured chat format, including supervised finetuning, model alignment using reinforcement learning, and model merging. Granite 4.0 instruct models feature improved instruction following (IF) and tool-calling capabilities, making them more effective in enterprise applications. - Developers: Granite Team, IBM - HF Collection: Granite 4.0 Language Models HF Collection - GitHub Repository: ibm-granite/granite-4.0-language-models - Website: Granite Docs - Release Date: October 2nd, 2025 - License: Apache 2.0 Supported Languages: English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. Users may finetune Granite 4.0 models for languages beyond these languages. Intended use: The model is designed to respond to general instructions and can be used to build AI assistants for multiple domains, including business applications. Capabilities Summarization Text classification Text extraction Question-answering Retrieval Augmented Generation (RAG) Code related tasks Function-calling tasks Multilingual dialog use cases Fill-In-the-Middle (FIM) code completions -- Generation: This is a simple example of how to use Granite-4.0-H-Tiny model. Install the following libraries: Then, copy the snippet from the section that is relevant for your use case. Expected output: Tool-calling: Granite-4.0-H-Tiny comes with enhanced tool calling capabilities, enabling seamless integration with external functions and APIs. To define a list of tools please follow OpenAI's function definition schema. This is an example of how to use Granite-4.0-H-Tiny model tool-calling ability: Expected output: Coming soon -- Evaluation Results: General T

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

Makeribm-granite
TypeLanguage models
Parameters (lead)6.9B
Context128k tokens
Variants1
Runs withtransformers
Released2025-09-16
Popularity95k downloads / month
Likes208
LicenceOpen weights

How it works

How language models work

Your prompttext / messagesTransformerattention over tokensNext-token loopgenerate + streamResponsetext · tool callsA language model reads your tokens and predicts the next one, again and again, streaming the reply back.

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

VariantParamsPrecisionVRAMFits 16 GBWeights
granite-4.0-h-tiny6.9BBF16~16 GBWeights ↗

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys granite-4-0-h-tiny for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (granite-4-0-h-tiny below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"granite-4-0-h-tiny","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Tags

transformers safetensors granitemoehybrid text-generation language granite-4.0 conversational eval-results endpoints_compatible deploy:azure

Papers

Licence

Open weights

Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗

Sources

Weights & code

Want granite-4.0-h-tiny on EU-owned hardware?

Request this model on EU hardware See what’s served now

Explore

More language models

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms