Model reference · open weights
cpm-ant is an open-weight language model from openbmb. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Maker | openbmb |
|---|---|
| Type | Language models |
| Task | Text gen |
| Runs with | transformers |
| Released | 2023-01-15 |
| Popularity | 12k downloads / month |
| Licence | Unknown |
About
pip install transformers
from transformers import CpmAntTokenizer, CpmAntForCausalLM
texts = "今天天气不错，"
model = CpmAntForCausalLM.from_pretrained("openbmb/cpm-ant-10b")
tokenizer = CpmAntTokenizer.from_pretrained("openbmb/cpm-ant-10b")
input_ids = tokenizer(texts, return_tensors="pt")
outputs = model.generate(**input_ids)
output_texts = tokenizer.batch_decode(outputs)
print(output_texts)
From the published model card. Full card on the HuggingFace links in the sidebar.
Using it via the API
Once AxForge deploys cpm-ant for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (cpm-ant below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"cpm-ant","messages":[{"role":"user","content":"Hello"}]}'
Create an account — your API key is available in the console. 5M tokens/month currently included with every new account at launch.