Model reference · open weights
gemma-4 is an open-weight language model from ggml-org, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
gemma-4-12B-it Run with https://llama.app Source models - https://huggingface.co/google/gemma-4-12B-it - https://huggingface.co/google/gemma-4-12B-it-assistant - https://huggingface.co/google/gemma-4-12B-it-qat-q40-unquantized-assistant - https://huggingface.co/google/gemma-4-12B-it-qat-q40-unquantized TODOs - add info - add dflash [!IMPORTANT] This model is automatically converted using https://github.com/ggml-org/convert
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | ggml-org |
|---|---|
| Type | Language models |
| Variants | 1 |
| Based on | google/gemma-4-12B-it |
| Released | 2026-06-03 |
| Popularity | 46k downloads / month |
| Likes | 85 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| gemma-4-12B-it-GGUF | — | GGUF | — | — | Weights ↗ |
Using it via the API
Once AxForge deploys ggml-org-gemma-4 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (ggml-org-gemma-4 below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"ggml-org-gemma-4","messages":[{"role":"user","content":"Hello"}]}'
Details
Tags
Licence
Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗