Model reference · open weights
Meta-Llama-3.1 is an open-weight language model from unsloth, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
Finetune Llama 3.1, Gemma 2, Mistral 2-5x faster with 70% less memory via Unsloth! We have a free Google Colab Tesla T4 notebook for Llama 3.1 (8B) here: https://colab.research.google.com/drive/1Ys44kVvmeZtnICzWz0xgpRnrIOjZAuxp?usp=sharing <img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/Discord%20button.png" width="200"/ <img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/ ✨ Finetune for Free All notebooks are beginner friendly! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face. <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="200"/ - This conversational notebook is useful for ShareGPT ChatML / Vicuna templates. - This text completion notebook is for raw text. This DPO notebook replicates Zephyr. - \ Kaggle has 2x T4s, but we use 1. Due to overhead, 1x T4 is 5x faster.
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | unsloth |
|---|---|
| Type | Language models |
| Parameters (lead) | 8.0B |
| Context | 128k tokens |
| Variants | 1 |
| Runs with | transformers |
| Based on | meta-llama/Llama-3.1-8B-Instruct |
| Released | 2024-07-23 |
| Popularity | 364k downloads / month |
| Likes | 98 |
| Licence | Open, with conditions |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| Meta-Llama-3.1-8B-Instruct | 8.0B | BF16 | ~18.5 GB | ✓ | Weights ↗ |
Using it via the API
Once AxForge deploys meta-llama-3-1 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (meta-llama-3-1 below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"meta-llama-3-1","messages":[{"role":"user","content":"Hello"}]}'
Details
Languages
Tags
Licence
Open weights under llama3.1, which carries conditions (e.g. attribution or an acceptable-use clause). Worth a read before production use — we can walk you through it. Read the licence ↗