Model reference · open weights
Falcon-H1 is an open-weight language model from tiiuae, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
Table of Contents 0. TL;DR 1. Model Details 2. Training Details 3. Usage 4. Evaluation 5. Citation TL;DR Model Details Model Description - Developed by: https://www.tii.ae - Model type: Causal decoder-only - Architecture: Hybrid Transformers + Mamba architecture - Language(s) (NLP): English - License: Falcon-LLM License Training details For more details about the training protocol of this model, please refer to the Falcon-H1 technical blogpost and Technical Report. Usage Currently to use this model you can either rely on Hugging Face transformers, vLLM or llama.cpp library. Inference Inference Make sure to install the latest version of transformers or vllm, eventually install these packages from source: For vLLM, make sure to install vllm=0.9.0: 🤗 transformers Refer to the snippet below to run H1 models using 🤗 transformers: vLLM For vLLM, simply start a server by executing the command below: llama.cpp You can find all GGUF files under our official collection Evaluation Falcon-H1 series perform very well on a variety of tasks, including reasoning tasks. You can check more in detail on our our release blogpost, detailed benchmarks. Useful links - View our release blogpost. - View our technical report. - Feel free to join our discord server if you have any questions or to interact with our researchers and developers. Citation If the Falcon-H1 family of models were helpful to your work, feel free to give us a cite.
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | tiiuae |
|---|---|
| Type | Language models |
| Parameters (lead) | 521M |
| Context | 16k tokens |
| Variants | 3 |
| Runs with | transformers |
| Released | 2025-05-01 |
| Popularity | 67k downloads / month |
| Likes | 36 |
| Licence | Commercial licence needed |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
Using it via the API
Once AxForge deploys falcon-h1 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (falcon-h1 below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"falcon-h1","messages":[{"role":"user","content":"Hello"}]}'
Licence
The weights are open but its licence needs a commercial agreement for business use. AxForge can arrange that licence and host the model for you — you pay AxForge, we settle with the model’s maker. Ask us for a quote. Read the licence ↗