Model reference · open weights
cross-encoder-mmarco-german-distilbert is an open-weight embedding model from ml6team. cross-encoder-mmarco-german-distilbert-base (FP32) weighs 271 MB; the smallest configuration that runs it is RTX 3060 12 GB.
Summary of the ml6team/cross-encoder-mmarco-german-distilbert-base model card, 2026-10-01
What it is
| Released by | ml6team |
|---|---|
| Released | 2022-04-26 |
| Parameters | 135M |
| VRAM | 271 MB for the weights |
What it runs on
| Card | Runs | Memory |
|---|---|---|
| RTX 3060 12 GB | fits | 11.6 GB |
| RTX 4060 Ti 16 GB | fits | 15.4 GB |
| RTX 3090 24 GB | fits | 23.4 GB |
| RTX 4090 24 GB | fits | 23.4 GB |
| RTX 5090 32 GB | fits | 31.0 GB |
| L40S 48 GB | fits | 44.0 GB |
| A100 80 GB | fits | 78.2 GB |
| H100 80 GB | fits | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | fits | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | fits | 107 GB |
| H200 141 GB | fits | 138 GB |
| B200 180 GB | fits | 176 GB |
From the model card
This model is a fine-tuned cross-encoder on the MMARCO dataset which is the machine translated version of the MS MARCO dataset. As base model for the fine-tuning we use distilbert-base-multilingual-cased
Model input samples are tuples of the following format, either
assigned to 1 or assigned to 0.
The model was trained for 1 epoch.
The cross-encoder model can be used like this:
from sentence_transformers import CrossEncoder
model = CrossEncoder('model_name')
scores = model.predict([('Query 1', 'Paragraph 1'), ('Query 2', 'Paragraph 2')])
The model will predict scores for the pairs ('Query 1', 'Paragraph 1') and ('Query 2', 'Paragraph 2').
For more details on the usage of the cross-encoder models have a look into the Sentence-Transformers
Model evaluation was done on 2000 evaluation paragraphs of the dataset.
| Accuracy | F1-Score | Precision | Recall |
|---|---|---|---|
| 89.70 | 86.82 | 86.82 | 93.50 |
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.