Model reference · open weights
gemma-4 is an open-weight language model from RedHatAI, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
gemma-4-12B-it-NVFP4 NVFP4 Quantized RedHatAI/gemma-4-12B-it-NVFP4 This is a preliminary version (and subject to change) of NVFP4 quantized google/gemma-4-12B-it model. The model has both weights and activations quantized to NVFP4 format with vllm-project/llm-compressor. It is compatible and tested against vllm nightly. Creation Script Run this script with this LLM Compressor PR and latest transformers to quantize the model using GPTQ Preliminary Evaluations 1) GSM8K Platinum 2) Wikitext PPL Evals:
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | RedHatAI |
|---|---|
| Type | Language models |
| Parameters (lead) | 13.0B |
| Variants | 1 |
| Runs with | transformers |
| Based on | google/gemma-4-12B-it |
| Released | 2026-06-08 |
| Popularity | 63k downloads / month |
| Likes | 5 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| gemma-4-12B-it-NVFP4 | 13.0B | NVFP4 | — | ✓ | Weights ↗ |
Using it via the API
Once AxForge deploys redhatai-gemma-4 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (redhatai-gemma-4 below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"redhatai-gemma-4","messages":[{"role":"user","content":"Hello"}]}'
Details
Tags
Licence
Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗