Model reference · open weights
persian-embeddings is an open-weight embedding model from heydariAI, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
heydariAI/persian-embeddings My Github: @heydaari My Linkedin: Mohammad Hassan Heydari This model is a fine-tuned version of xlm-roberta-base, specifically trained on a massive corpus of Persian data to create high-quality contextual embeddings for Persian sentences and paragraphs. It is designed to perform exceptionally well on tasks such as semantic search, clustering, and contextual similarity for Persian text, while also supporting multilingual tasks in English and Persian. The fine-tuning process focused on adapting the pre-trained multilingual XLM-RoBERTa model to better capture Persian linguistic nuances, making it highly effective for tasks requiring embeddings tailored to the Persian language. Usage (Sentence-Transformers) Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Usage (HuggingFace Transformers) Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings.
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | heydariAI |
|---|---|
| Type | Embedding models |
| Parameters (lead) | 560M |
| Context | 514 tokens |
| Variants | 1 |
| Runs with | transformers |
| Based on | FacebookAI/xlm-roberta-base |
| Released | 2024-11-21 |
| Popularity | 88k downloads / month |
| Likes | 40 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| persian-embeddings | 560M | BF16 | ~1.3 GB | ✓ | Weights ↗ |
Using it via the API
Once AxForge deploys persian-embeddings for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (persian-embeddings below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/embeddings \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"persian-embeddings","input":"text to embed"}'
Details
Languages
Tags
Licence
Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗
Explore