Model reference · open weights

Llama-Guard-4

LLMs meta-llama Vision + text 1 build Its own licence terms 90k dl/mo

Llama-Guard-4 is an open-weight language model from Meta. Llama-Guard-4-12B (BF16) weighs 24.0 GB; the smallest configuration that runs it is RTX 5090 32 GB.

  • Llama-Guard-4 is a 12-billion parameter multimodal safety classifier developed by Meta for classifying text and image content as safe or unsafe.
  • It supports English and multilingual text prompts along with mixed text-and-image inputs, and it is licensed under an other license.
  • The model uses a dense architecture pruned from Llama 4 Scout and is designed to run on a single GPU.

Summary of the meta-llama/Llama-Guard-4-12B model card, 2026-10-01

What it is

Released byMeta
Released2025-04-23
Parameters12.0B
VRAM24.0 GB for the weights

What it runs on

Memory and cards for Llama-Guard-4-12B (BF16)

24.0 GBweights, file size
762 MBruntime overhead, at least

How much memory each request adds isn't estimated yet for this architecture. The weights need at least the cards below, plus room for the context.

CardWeights alone
RTX 3060 12 GB … RTX 4090 24 GB
4 smaller cards
does not fit
RTX 5090 32 GBfits
L40S 48 GBfits
A100 80 GBfits
H100 80 GBfits
RTX PRO 6000 Blackwell 96 GBfits
DGX Spark (GB10) 128 GB unifiedfits
H200 141 GBfits
B200 180 GBfits

How it works

How language models work

Your prompttext / messagesTransformerattention over tokensNext-token loopgenerate + streamResponsetext · tool callsA language model reads your tokens and predicts the next one, again and again, streaming the reply back.
© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms