Model reference · open weights

Llama-3.1

Llama-3.1 is an open-weight language model from meta-llama, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.

LLMs meta-llama 4 variants 5.9M downloads/mo
Request this model on EU hardware All served models Not on the shared API today — deployed on request.

Specifications

What it is

Makermeta-llama
TypeLanguage models
Parameters (lead)8.0B
Variants4
Runs withtransformers
Based onmeta-llama/Meta-Llama-3.1-8B
Released2024-07-18
Popularity5.9M downloads / month
Likes6,707
LicenceOpen, with conditions

How it works

How language models work

Your prompttext / messagesTransformerattention over tokensNext-token loopgenerate + streamResponsetext · tool callsA language model reads your tokens and predicts the next one, again and again, streaming the reply back.

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

VariantParamsPrecisionVRAMFits 16 GBWeights
Llama-3.1-8B-Instruct8.0BBF16~18.5 GBWeights ↗
Llama-3.1-70B-Instruct70.6BBF16~162.3 GBWeights ↗
Llama-3.1-405B-FP8405.9BFP8~466.7 GBWeights ↗
Llama-3.1-405B405.9BBF16~933.5 GBWeights ↗

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys llama-3-1 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (llama-3-1 below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"llama-3-1","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Languages

en de fr it pt hi es th

Tags

transformers safetensors llama text-generation facebook meta pytorch llama-3 conversational en de fr it pt

Papers

Licence

Open, with conditions

Open weights under llama3.1, which carries conditions (e.g. attribution or an acceptable-use clause). Worth a read before production use — we can walk you through it. Read the licence ↗

Sources

Weights & code

Want Llama-3.1 on EU-owned hardware?

Request this model on EU hardware See what’s served now

Explore

More language models

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms