Model reference · open weights
rubert-cased is an open-weight embedding model from DeepPavlov, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
rubert-base-cased RuBERT \(Russian, cased, 12‑layer, 768‑hidden, 12‑heads, 180M parameters\) was trained on the Russian part of Wikipedia and news data. We used this training data to build a vocabulary of Russian subtokens and took a multilingual version of BERT‑base as an initialization for RuBERT\[1\]. 08.11.2021: upload model with MLM and NSP heads \[1\]: Kuratov, Y., Arkhipov, M. \(2019\). Adaptation of Deep Bidirectional Multilingual Transformers for Russian Language. arXiv preprint arXiv:1905.07213.
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | DeepPavlov |
|---|---|
| Type | Embedding models |
| Context | 512 tokens |
| Variants | 1 |
| Runs with | transformers |
| Released | 2022-03-02 |
| Popularity | 186k downloads / month |
| Likes | 134 |
| Licence | Commercial licence needed |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| rubert-base-cased | — | BF16 | — | — | Weights ↗ |
Using it via the API
Once AxForge deploys rubert-cased for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (rubert-cased below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/embeddings \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"rubert-cased","input":"text to embed"}'
Licence
The weights are open but its licence needs a commercial agreement for business use. AxForge can arrange that licence and host the model for you — you pay AxForge, we settle with the model’s maker. Ask us for a quote. Read the licence ↗
Explore