Model reference · open weights
falcon is an open-weight language model from tiiuae, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
🚀 Falcon-7B Falcon-7B is a 7B parameters causal decoder-only model built by TII and trained on 1,500B tokens of RefinedWeb enhanced with curated corpora. It is made available under the Apache 2.0 license. Paper coming soon 😊. 🤗 To get started with Falcon (inference, finetuning, quantization, etc.), we recommend reading this great blogpost fron HF! Why use Falcon-7B? It outperforms comparable open-source models (e.g., MPT-7B, StableLM, RedPajama etc.), thanks to being trained on 1,500B tokens of RefinedWeb enhanced with curated corpora. See the OpenLLM Leaderboard. It features an architecture optimized for inference, with FlashAttention (Dao et al., 2022) and multiquery (Shazeer et al., 2019). It is made available under a permissive Apache 2.0 license allowing for commercial use, without any royalties or restrictions. ⚠️ This is a raw, pretrained model, which should be further finetuned for most usecases. If you are looking for a version better suited to taking generic instructions in a chat format, we recommend taking a look at Falcon-7B-Instruct. 🔥 Looking for an even more powerful model? Falcon-40B is Falcon-7B's big brother! 💥 Falcon LLMs require PyTorch 2.0 for use with transformers! For fast inference with Falcon, check-out Text Generation Inference! Read more in this blogpost. You will need at least 16GB of memory to swiftly run inference with Falcon-7B. Model Card for Falcon-7B Model Details Model Description - Developed by: https://www.tii.ae; - Model type: Causal decoder-only; - Language(s) (NLP): English, German, Spanish, French (and limited capabilities in Italian, Portuguese, Polish, Dutch, Romanian, Czech, Swedish); - License: Apache 2.0. Model Source - Paper: coming soon. Uses Direct Use Research on large language models; as a foundation for further specialization and finetuning for specific usecases (e.g., summarization, text generation, chatbot, etc.) Out-of-Scope Use Production use without adequate assessment of risks and mitigation; any use cases which may be considered irresponsible or harmful. Bias, Risks, and Limitations Falcon-7B is trained on English and French data only, and will not generalize appropriately to other languages. Furthermor
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | tiiuae |
|---|---|
| Type | Language models |
| Parameters (lead) | 7.2B |
| Variants | 4 |
| Runs with | transformers |
| Released | 2023-04-24 |
| Popularity | 606k downloads / month |
| Likes | 2,439 |
| Licence | Commercial licence needed |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
Using it via the API
Once AxForge deploys falcon for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (falcon below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"falcon","messages":[{"role":"user","content":"Hello"}]}'
Details
Languages
Trained / evaluated on
Tags
Papers
Licence
The weights are open but apache-2.0 needs a commercial agreement for business use. AxForge can arrange that licence and host the model for you — you pay AxForge, we settle with the model’s maker. Ask us for a quote. Read the licence ↗