Model reference · open weights
paraphrase-mpnet is an open-weight embedding model from sentence-transformers, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
sentence-transformers/paraphrase-mpnet-base-v2 This is a sentence-transformers model: It maps sentences & paragraphs to a 768 dimensional dense vector space and can be used for tasks like clustering or semantic search. Usage (Sentence-Transformers) Using this model becomes easy when you have sentence-transformers installed: Then you can use the model like this: Usage (HuggingFace Transformers) Without sentence-transformers, you can use the model like this: First, you pass your input through the transformer model, then you have to apply the right pooling-operation on-top of the contextualized word embeddings. Usage (Text Embeddings Inference (TEI)) Text Embeddings Inference (TEI) is a blazing fast inference solution for text embedding models. - CPU: - NVIDIA GPU: Send a request to /v1/embeddings to generate embeddings via the OpenAI Embeddings API: Or check the Text Embeddings Inference API specification instead. Full Model Architecture Citing & Authors This model was trained by sentence-transformers. If you find this model helpful, feel free to cite our publication Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks:
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | sentence-transformers |
|---|---|
| Type | Embedding models |
| Parameters (lead) | 109M |
| Context | 514 tokens |
| Variants | 1 |
| Runs with | sentence-transformers |
| Released | 2022-03-02 |
| Popularity | 1.9M downloads / month |
| Likes | 50 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| paraphrase-mpnet-base-v2 | 109M | BF16 | ~0.3 GB | ✓ | Weights ↗ |
Using it via the API
Once AxForge deploys paraphrase-mpnet for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (paraphrase-mpnet below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/embeddings \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"paraphrase-mpnet","input":"text to embed"}'
Licence
Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗
Explore