Model reference · open weights
Yi is an open-weight language model from 01-ai, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
🤗 <a href="https://huggingface.co/01-ai" target="blank"Hugging Face</a • 🤖 <a href="https://www.modelscope.cn/organization/01ai/" target="blank"ModelScope</a • ✡️ <a href="https://wisemodel.cn/organization/01.AI" target="blank"WiseModel</a 👩🚀 Ask questions or discuss ideas on <a href="https://github.com/01-ai/Yi/discussions" target="blank" GitHub </a 👋 Join us on <a href="https://discord.gg/hYUwWddeAu" target="blank" 👾 Discord </a or <a href="有官方的微信群嘛 · Issue #43 · 01-ai/Yi" target="blank" 💬 WeChat </a 📝 Check out <a href="https://arxiv.org/abs/2403.04652" Yi Tech Report </a 📚 Grow at <a href="#learning-hub" Yi Learning Hub </a - What is Yi? - Introduction - Models - Chat models - Base models - Model info - News - How to use Yi? - Quick start - Choose your path - pip - docker - llama.cpp - conda-lock - Web demo - Fine-tuning - Quantization - Deployment - FAQ - Learning hub - Why Yi? - Ecosystem - Upstream - Downstream - Serving - Quantization - Fine-tuning - API - Benchmarks - Base model performance - Chat model performance - Tech report - Citation - Who can use Yi? - Misc. - Acknowledgements - Disclaimer - License What is Yi? Introduction - 🤖 The Yi series models are the next generation of open-source large language models trained from scratch by 01.AI. - 🙌 Targeted as a bilingual language model and trained on 3T multilingual corpus, the Yi series models become one of the strongest LLM worldwide, showing promise in language understanding, commonsense reasoning, reading comprehension, and more. For example, - Yi-34B-Chat model landed in second place (following GPT-4 Turbo), outperforming other LLMs (such as GPT-4, Mixtral, Claude) on the AlpacaEval Leaderboard (based on data available up to January 2024). - Yi-34B model ranked first among all existing open-source models (such as Falcon-180B, Llama-70B, Claude) in both English and Chinese on various benchmarks, including Hugging Face Open LLM Leaderboard (pre-trained) and C-Eval (based on data available up to November 2023). - 🙏 (Credits to Llama) Thanks to the Transformer and Llama open-source communities, as they reduce the efforts required to build from scratch and enable the utilization of the same tools wit
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | 01-ai |
|---|---|
| Type | Language models |
| Parameters (lead) | 6.1B |
| Context | 4k tokens |
| Variants | 3 |
| Runs with | transformers |
| Released | 2023-11-01 |
| Popularity | 33k downloads / month |
| Likes | 1,302 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
Using it via the API
Once AxForge deploys yi for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (yi below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"yi","messages":[{"role":"user","content":"Hello"}]}'
Details
Tags
Papers
Licence
Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗