Model reference · open weights
MiniCPM3 is an open-weight language model from openbmb, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
Join us in <a href="https://discord.gg/3cGQn9b3YM" target="blank"Discord</a and <a href="https://github.com/OpenBMB/MiniCPM/blob/main/assets/wechat.jpg" target="blank"WeChat</a Introduction MiniCPM3-4B is the 3rd generation of MiniCPM series. The overall performance of MiniCPM3-4B surpasses Phi-3.5-mini-Instruct and GPT-3.5-Turbo-0125, being comparable with many recent 7B~9B models. Compared to MiniCPM1.0/MiniCPM2.0, MiniCPM3-4B has a more powerful and versatile skill set to enable more general usage. MiniCPM3-4B supports function call, along with code interpreter. Please refer to Advanced Features for usage guidelines. MiniCPM3-4B has a 32k context window. Equipped with LLMxMapReduce, MiniCPM3-4B can handle infinite context theoretically, without requiring huge amount of memory. Usage Inference with Transformers Inference with vLLM For now, you need to install our forked version of vLLM. Evaluation Results Statement As a language model, MiniCPM3-4B generates content by learning from a vast amount of text. However, it does not possess the ability to comprehend or express personal opinions or value judgments. Any content generated by MiniCPM3-4B does not represent the viewpoints or positions of the model developers. Therefore, when using content generated by MiniCPM3-4B, users should take full responsibility for evaluating and verifying it on their own. LICENSE This repository is released under the Apache-2.0 License. The usage of MiniCPM3-4B model weights must strictly follow MiniCPM Model License.md. The models and weights of MiniCPM3-4B are completely free for academic research. after filling out a "questionnaire" for registration, are also available for free commercial use. Citation
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | openbmb |
|---|---|
| Type | Language models |
| Context | 32k tokens |
| Variants | 1 |
| Runs with | transformers |
| Released | 2024-09-03 |
| Popularity | 27k downloads / month |
| Likes | 420 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| MiniCPM3-4B | — | BF16 | — | — | Weights ↗ |
Using it via the API
Once AxForge deploys minicpm3 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (minicpm3 below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"minicpm3","messages":[{"role":"user","content":"Hello"}]}'
Licence
Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗