Model reference · open weights
grok-1 is an open-weight language model from xai-org. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Maker | xai-org |
|---|---|
| Type | Language models |
| Task | Text gen |
| Runs with | grok |
| Released | 2024-03-17 |
| Popularity | 929 downloads / month |
| Licence | Open weights |
About
This repository contains the weights of the Grok-1 open-weights model. You can find the code in the GitHub Repository.
Clone the repo & download the int8 checkpoint to the checkpoints directory by executing this command in the repo root directory:
git clone https://github.com/xai-org/grok-1.git && cd grok-1
pip install huggingface_hub[hf_transfer]
huggingface-cli download xai-org/grok-1 --repo-type model --include ckpt-0/* --local-dir checkpoints --local-dir-use-symlinks False
Then, you can run:
pip install -r requirements.txt
python run.py
You should be seeing output from the language model.
Due to the large size of the model (314B parameters), a multi-GPU machine is required to test the model with the example code.
p.s. we're hiring: https://x.ai/careers
From the published model card. Full card on the HuggingFace links in the sidebar.
How it works
Using it via the API
Once AxForge deploys grok-1 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (grok-1 below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"grok-1","messages":[{"role":"user","content":"Hello"}]}'
Create an account — your API key is available in the console. 5M tokens/month currently included with every new account at launch.