Model reference · open weights
quora-distilroberta is an open-weight embedding model from cross-encoder, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
Cross-Encoder for Quora Duplicate Questions Detection This model was trained using SentenceTransformers Cross-Encoder class. Training Data This model was trained on the Quora Duplicate Questions dataset. The model will predict a score between 0 and 1 how likely the two given questions are duplicates. Note: The model is not suitable to estimate the similarity of questions, e.g. the two questions "How to learn Java" and "How to learn Python" will result in a rather low score, as these are not duplicates. Usage and Performance Pre-trained models can be used like this: You can use this model also without sentencetransformers and by just using Transformers AutoModel class
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | cross-encoder |
|---|---|
| Type | Embedding models |
| Parameters (lead) | 82M |
| Context | 514 tokens |
| Variants | 1 |
| Runs with | sentence-transformers |
| Based on | distilbert/distilroberta-base |
| Released | 2022-03-02 |
| Popularity | 100k downloads / month |
| Likes | 1 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| quora-distilroberta-base | 82M | BF16 | ~0.2 GB | ✓ | Weights ↗ |
Using it via the API
Once AxForge deploys quora-distilroberta for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (quora-distilroberta below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/embeddings \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"quora-distilroberta","input":"text to embed"}'
Details
Languages
Trained / evaluated on
Tags
Licence
Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗
Explore