Model reference · open weights
Llama-2 is an open-weight language model from meta-llama, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
Specifications
| Maker | meta-llama |
|---|---|
| Type | Language models |
| Parameters (lead) | 6.7B |
| Variants | 3 |
| Runs with | transformers |
| Released | 2023-07-13 |
| Popularity | 805k downloads / month |
| Likes | 4,825 |
| Licence | Open, with conditions |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
Using it via the API
Once AxForge deploys llama-2 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (llama-2 below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"llama-2","messages":[{"role":"user","content":"Hello"}]}'
Licence
Open weights under llama2, which carries conditions (e.g. attribution or an acceptable-use clause). Worth a read before production use — we can walk you through it. Read the licence ↗