Model reference · open weights
llama3-CLA-3 is an open-weight language model from answerdotai. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Maker | answerdotai |
|---|---|
| Type | Language models |
| Task | Text gen |
| Context | 8k tokens |
| Runs with | transformers |
| Released | 2024-07-18 |
| Popularity | 11 downloads / month |
| Licence | Unknown |
About
Transformers : https://github.com/huggingface/transformers/blob/47fedc1665f14a60260b1b8357e682669300093a/src/transformers/models/llama/modeling_llama.py
Training Script: https://github.com/AnswerDotAI/fsdp_qlora/blob/3f7c583e985ff35e37a7b7497a7d4fedb77df695/experiments/cla/train.sh
This model shares KV activations every 3 layers. For example, layer 1 and 2 uses layer 0 kv activations, layer 4 and 5 uses layer 3 kv activations, etc..
From the published model card. Full card on the HuggingFace links in the sidebar.
Using it via the API
Once AxForge deploys llama3-cla-3 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (llama3-cla-3 below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"llama3-cla-3","messages":[{"role":"user","content":"Hello"}]}'
Create an account — your API key is available in the console. 5M tokens/month currently included with every new account at launch.