Model reference · open weights
bigscience-small-testing is an open-weight language model from bigscience. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Maker | bigscience |
|---|---|
| Type | Language models |
| Task | Text gen |
| Parameters (lead) | 16M |
| Runs with | transformers |
| Released | 2022-04-22 |
| Popularity | 12k downloads / month |
| Licence | Unknown |
About
This model aims to test the conversion between Megatron-LM and transformers. It is a small GPT-2-like model that has been used to debug the script. Use it only for integration tests
From the published model card. Full card on the HuggingFace links in the sidebar.
Using it via the API
Once AxForge deploys bigscience-small-testing for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (bigscience-small-testing below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"bigscience-small-testing","messages":[{"role":"user","content":"Hello"}]}'
Create an account — your API key is available in the console. 5M tokens/month currently included with every new account at launch.