Model reference · open weights
cross-encoder-russian-msmarco is an open-weight embedding model from DiTy, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
DiTy/cross-encoder-russian-msmarco This is a sentence-transformers model based on a pre-trained DeepPavlov/rubert-base-cased and finetuned with MS-MARCO Russian passage ranking dataset. The model can be used for Information Retrieval in the Russian language: Given a query, encode the query will all possible passages (e.g. retrieved with ElasticSearch). Then sort the passages in a decreasing order. See SBERT.net Retrieve & Re-rank for more details. Usage (Sentence-Transformers) Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Usage (HuggingFace Transformers) Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you need to get the logits from the model.
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | DiTy |
|---|---|
| Type | Embedding models |
| Parameters (lead) | 178M |
| Context | 512 tokens |
| Variants | 1 |
| Runs with | sentence-transformers |
| Based on | DeepPavlov/rubert-base-cased |
| Released | 2024-04-19 |
| Popularity | 78k downloads / month |
| Likes | 29 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| cross-encoder-russian-msmarco | 178M | BF16 | ~0.4 GB | ✓ | Weights ↗ |
Using it via the API
Once AxForge deploys cross-encoder-russian-msmarco for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (cross-encoder-russian-msmarco below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/embeddings \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"cross-encoder-russian-msmarco","input":"text to embed"}'
Details
Languages
Trained / evaluated on
Tags
Licence
Open weights under mit — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗
Explore