Model reference · open weights

gemma-2

gemma-2 is an open-weight language model from google, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.

LLMs google 2 variants 759k downloads/mo
Request this model on EU hardware All served models Not on the shared API today — deployed on request.

Specifications

What it is

Makergoogle
TypeLanguage models
Parameters (lead)2.6B
Variants2
Runs withtransformers
Based ongoogle/gemma-2-2b
Released2024-07-16
Popularity759k downloads / month
Likes1,470
LicenceOpen, with conditions

How it works

How language models work

Your prompttext / messagesTransformerattention over tokensNext-token loopgenerate + streamResponsetext · tool callsA language model reads your tokens and predicts the next one, again and again, streaming the reply back.

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

VariantParamsPrecisionVRAMFits 16 GBWeights
gemma-2-2b-it2.6BBF16~6 GBWeights ↗
gemma-2-9b-it9.2BBF16~21.3 GBWeights ↗

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys gemma-2 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (gemma-2 below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"gemma-2","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Tags

transformers safetensors gemma2 text-generation conversational eval-results text-generation-inference endpoints_compatible deploy:sagemaker

Papers

Licence

Open, with conditions

Open weights under gemma, which carries conditions (e.g. attribution or an acceptable-use clause). Worth a read before production use — we can walk you through it. Read the licence ↗

Sources

Weights & code

Want gemma-2 on EU-owned hardware?

Request this model on EU hardware See what’s served now

Explore

More language models

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms