Model reference · open weights
Supra1.5-exp is an open-weight language model from SupraLabs. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Released by | SupraLabs |
|---|---|
| Type | Language models |
| Task | Text gen |
| Parameters (lead) | 52M |
| Context | 5k tokens |
| Runs with | transformers |
| Released | 2026-06-10 |
| Popularity | 649 downloads / month |
| Licence | Open weights |
About
Continued Pretraining • 50M Parameters • 5K Context
Supra-1.5-50M-Base-exp is a continued-pretrained 50M parameter Llama-style base
model derived from SupraLabs/Supra-50M-Base. The target update expands the
usable context window from 1,024 tokens to 5,120 tokens using RoPE scaling and
full-weight continued pretraining.
The model keeps the original Supra-50M architecture and tokenizer:
| Specification | Value |
|---|---|
| Architecture | LlamaForCausalLM |
| Parameters | ~50M |
| Vocabulary Size | 32,000 |
| Hidden Size | 512 |
| Layers | 12 |
| Attention Heads | 8 |
| KV Heads | 4 |
| Context Length | 5,120 tokens |
| Tokenizer | Original Supra byte-level BPE tokenizer |
This is CPT, not instruction fine-tuning. Training uses packed raw text with standard causal language-modeling loss:
labels = input_idsThe current local training mix prepared for this run is:
Supervised Fine-Tuning (SFT) and Reinforcement Learning
Credit goes to @QyrouNnet-AI
From the published model card. Full card on the HuggingFace links in the sidebar.
Using it via the API
Once AxForge deploys supra1-5-exp for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (supra1-5-exp below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"supra1-5-exp","messages":[{"role":"user","content":"Hello"}]}'
Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.