Model reference · open weights
OpenHathi-Hi is an open-weight language model from sarvamai. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Maker | sarvamai |
|---|---|
| Type | Language models |
| Task | Text gen |
| Parameters (lead) | 6.9B |
| Context | 4k tokens |
| Runs with | transformers |
| Released | 2023-12-13 |
| Popularity | 1k downloads / month |
| Licence | Open, with conditions |
About
This repository is the first model in the OpenHathi series of models that will be released by Sarvam AI. This is a 7B parameter, based on Llama2, trained on Hindi, English, and Hinglish. More details about the model, its training procedure, and evaluations can be found here.
Note: this is a base model and not meant to be used as is. We recommend first finetuning it on task(s) you are interested in.
# Usage
import torch
from transformers import LlamaTokenizer, LlamaForCausalLM
tokenizer = LlamaTokenizer.from_pretrained('sarvamai/OpenHathi-7B-Hi-v0.1-Base')
model = LlamaForCausalLM.from_pretrained('sarvamai/OpenHathi-7B-Hi-v0.1-Base', torch_dtype=torch.bfloat16)
prompt = "मैं एक अच्छा हाथी हूँ"
inputs = tokenizer(prompt, return_tensors="pt")
# Generate
generate_ids = model.generate(inputs.input_ids, max_length=30)
tokenizer.batch_decode(generate_ids, skip_special_tokens=True, clean_up_tokenization_spaces=False)[0]
From the published model card. Full card on the HuggingFace links in the sidebar.
Using it via the API
Once AxForge deploys openhathi-hi for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (openhathi-hi below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"openhathi-hi","messages":[{"role":"user","content":"Hello"}]}'
Create an account — your API key is available in the console. 5M tokens/month currently included with every new account at launch.