Model reference · open weights
mamba is an open-weight language model from state-spaces, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
Mamba This repository contains the transfromers compatible mamba-2.8b. The checkpoints are untouched, but the full config.json and tokenizer are pushed to this repo. Usage You need to install transformers from main until transformers=4.39.0 is released. We also recommend you to install both causalconv1d and mamba-ssm using: If any of these two is not installed, the "eager" implementation will be used. Otherwise the more optimised cuda kernels will be used. Generation You can use the classic generate API: PEFT finetuning example In order to finetune using the peft library, we recommend keeping the model in float32!
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | state-spaces |
|---|---|
| Type | Language models |
| Parameters (lead) | 129M |
| Variants | 5 |
| Runs with | transformers |
| Released | 2024-03-06 |
| Popularity | 322k downloads / month |
| Likes | 123 |
| Licence | Commercial licence needed |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
Using it via the API
Once AxForge deploys mamba for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (mamba below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"mamba","messages":[{"role":"user","content":"Hello"}]}'
Details
Tags
Licence
The weights are open but its licence needs a commercial agreement for business use. AxForge can arrange that licence and host the model for you — you pay AxForge, we settle with the model’s maker. Ask us for a quote. Read the licence ↗