Model reference · open weights
L3-Lunaris is an open-weight language model from Sao10K. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Released by | Sao10K |
|---|---|
| Type | Language models |
| Task | Text gen |
| Parameters (lead) | 8.0B |
| Context | 8k tokens |
| Runs with | transformers |
| Released | 2024-06-26 |
| Popularity | 1k downloads / month |
| Licence | Open, with conditions |
About
A generalist / roleplaying model merge based on Llama 3. Models are selected from my personal experience while using them.
I personally think this is an improvement over Stheno v3.2, considering the other models helped balance out its creativity and at the same time improving its logic.
Settings:
Instruct // Context Template: Llama-3-Instruct
Temperature: 1.4
min_p: 0.1
Merging seems to be a black box magic though? In my personal experience merging multiple models from different datasets / data works better than combining them all in one.
Values chosen are from long-running personal experimentation since Llama-2 Merging Era. I have tweaked them to fit this recipe.
Mergekit Config
models:
- model: meta-llama/Meta-Llama-3-8B-Instruct
- model: crestf411/L3-8B-sunfall-v0.1 # Another RP Model trained on... stuff
parameters:
density: 0.4
weight: 0.25
- model: Hastagaras/Jamet-8B-L3-MK1 - # Another RP / Storytelling Model
parameters:
density: 0.5
weight: 0.3
- model: maldv/badger-iota-llama-3-8b #Megamerge - Helps with General Knowledge
parameters:
density: 0.6
weight: 0.35
- model: Sao10K/Stheno-3.2-Beta # This is Stheno v3.2's Initial Name
parameters:
density: 0.7
weight: 0.4
merge_method: ties
base_model: meta-llama/Meta-Llama-3-8B-Instruct
parameters:
int8_mask: true
rescale: true
normalize: false
dtype: bfloat16
From the published model card. Full card on the HuggingFace links in the sidebar.
Using it via the API
Once AxForge deploys l3-lunaris for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (l3-lunaris below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"l3-lunaris","messages":[{"role":"user","content":"Hello"}]}'
Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.