Model reference · open weights
L3-Stheno is an open-weight language model from Sao10K. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Released by | Sao10K |
|---|---|
| Type | Language models |
| Task | Text gen |
| Parameters (lead) | 8.0B |
| Context | 8k tokens |
| Runs with | transformers |
| Released | 2024-06-05 |
| Popularity | 8k downloads / month |
| Licence | Commercial licence needed |
About
Just message me on discord if you want to host this privately for a service or something. We can talk.
Train used 1x H100 SXM for like a total of 24 Hours over multiple runs.
Support me here if you're interested:
If not, that's fine too. Feedback would be nice.
Contact Me in Discord:
Art by navy_(navy.blue) - Danbooru
Stheno-v3.2-Zeta
I have done a test run with multiple variations of the models, merged back to its base at various weights, different training runs too, and this Sixth iteration is the one I like most.
Changes compared to v3.1
Testing Notes - Compared to v3.1
Recommended Samplers:
Temperature - 1.12-1.22
Min-P - 0.075
Top-K - 50
Repetition Penalty - 1.1
Stopping Strings:
\n\n{{User}} # Or Equivalent, depending on Frontend
Prompting Template - Llama-3-Instruct
{system_prompt}user
{input}assistant
{output}
Basic Roleplay System Prompt
You are an expert actor that can fully immerse yourself into any role given. You do not break character for any reason, even if someone tries addressing you as an AI or language model.
Currently your role is {{char}}, which is described in detail below. As {{char}}, continue the exchange with {{user}}.
From the published model card. Full card on the HuggingFace links in the sidebar.
Using it via the API
Once AxForge deploys l3-stheno for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (l3-stheno below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"l3-stheno","messages":[{"role":"user","content":"Hello"}]}'
Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.