Model reference · open weights
modernbert-embed-unsupervised is an open-weight embedding model from nomic-ai. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Maker | nomic-ai |
|---|---|
| Type | Embedding models |
| Task | Embeddings |
| Parameters (lead) | 149M |
| Context | 8k tokens |
| Runs with | sentence-transformers |
| Based on | answerdotai/ModernBERT-base |
| Released | 2024-12-22 |
| Popularity | 121 downloads / month |
| Licence | Open weights |
About
modernbert-embed-unsupervised is the unsupervised checkpoint trained with the contrastors library
for 1 epoch over the 235M weakly-supervised contrastive pairs curated in Nomic Embed.
We suggest using moderbert-embed for embedding tasks.
The modernbert-unsupervised model performs similarly to the nomic-embed-text-v1_unsup model
| Model | Average (56) | Classification (12) | Clustering (11) | Pair Classification (3) | Reranking (4) | Retrieval (15) | STS (10) | Overall |
|---|---|---|---|---|---|---|---|---|
| nomic-embed-text-v1_unsup | 59.9 | 71.2 | 42.5 | 83.7 | 55.0 | 48.0 | 80.8 | 30.7 |
| modernbert-embed-unsupervised | 60.03 | 72.11 | 44.34 | 82.78 | 55.0 | 47.05 | 80.33 | 31.2 |
From the published model card. Full card on the HuggingFace links in the sidebar.
Benchmarks
As published on the model card — the maker's own numbers, not measured by AxForge.
| Task | Dataset | Metric | Score |
|---|---|---|---|
| Classification | MTEB AmazonCounterfactualClassification (en) | accuracy | 76.209 |
| Classification | MTEB AmazonCounterfactualClassification (en) | ap | 39.251 |
| Classification | MTEB AmazonCounterfactualClassification (en) | f1 | 70.152 |
| Classification | MTEB AmazonPolarityClassification | accuracy | 91.661 |
| Classification | MTEB AmazonPolarityClassification | ap | 88.673 |
| Classification | MTEB AmazonPolarityClassification | f1 | 91.653 |
| Classification | MTEB AmazonReviewsClassification (en) | accuracy | 46.768 |
| Classification | MTEB AmazonReviewsClassification (en) | f1 | 46.153 |
| Retrieval | MTEB ArguAna | map_at_1 | 24.964 |
| Retrieval | MTEB ArguAna | map_at_10 | 39.891 |
| Retrieval | MTEB ArguAna | map_at_100 | 41.015 |
| Retrieval | MTEB ArguAna | map_at_1000 | 41.027 |
| Retrieval | MTEB ArguAna | map_at_20 | 40.789 |
| Retrieval | MTEB ArguAna | map_at_3 | 35.017 |
| Retrieval | MTEB ArguAna | map_at_5 | 37.445 |
| Retrieval | MTEB ArguAna | mrr_at_1 | 25.462 |
| Retrieval | MTEB ArguAna | mrr_at_10 | 40.081 |
| Retrieval | MTEB ArguAna | mrr_at_100 | 41.204 |
| Retrieval | MTEB ArguAna | mrr_at_1000 | 41.216 |
| Retrieval | MTEB ArguAna | mrr_at_20 | 40.979 |
| Retrieval | MTEB ArguAna | mrr_at_3 | 35.171 |
| Retrieval | MTEB ArguAna | mrr_at_5 | 37.660 |
| Retrieval | MTEB ArguAna | ndcg_at_1 | 24.964 |
| Retrieval | MTEB ArguAna | ndcg_at_10 | 48.816 |
Using it via the API
Once AxForge deploys modernbert-embed-unsupervised for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (modernbert-embed-unsupervised below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/embeddings \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"modernbert-embed-unsupervised","input":"text to embed"}'
Create an account — your API key is available in the console. 5M tokens/month currently included with every new account at launch.