Model reference · open weights

cross-encoder-mmarco-german-distilbert

Embeddings ml6team Reranker 1 build Open weights 1k dl/mo

cross-encoder-mmarco-german-distilbert is an open-weight embedding model from ml6team. cross-encoder-mmarco-german-distilbert-base (FP32) weighs 271 MB; the smallest configuration that runs it is RTX 3060 12 GB.

  • The cross-encoder-mmarco-german-distilbert is a text-ranking model developed by ml6team for German language applications.
  • It is a fine-tuned version of distilbert-base-multilingual-cased trained on the MMARCO dataset, which is a machine-translated version of MS MARCO.
  • The model contains 135 million parameters, supports a context length of 512 tokens, and is released under the apache-2.0 licence.

Summary of the ml6team/cross-encoder-mmarco-german-distilbert-base model card, 2026-10-01

What it is

Released byml6team
Released2022-04-26
Parameters135M
VRAM271 MB for the weights

What it runs on

Memory and cards for cross-encoder-mmarco-german-distilbert-base (FP32)

271 MBweights, file size
1.1 GBruntime overhead
CardRunsMemory
RTX 3060 12 GBfits11.6 GB
RTX 4060 Ti 16 GBfits15.4 GB
RTX 3090 24 GBfits23.4 GB
RTX 4090 24 GBfits23.4 GB
RTX 5090 32 GBfits31.0 GB
L40S 48 GBfits44.0 GB
A100 80 GBfits78.2 GB
H100 80 GBfits78.1 GB
RTX PRO 6000 Blackwell 96 GBfits93.8 GB
DGX Spark (GB10) 128 GB unifiedfits107 GB
H200 141 GBfits138 GB
B200 180 GBfits176 GB

From the model card

What ml6team says about cross-encoder-mmarco-german-distilbert

Read the model card

Model description:

This model is a fine-tuned cross-encoder on the MMARCO dataset which is the machine translated version of the MS MARCO dataset. As base model for the fine-tuning we use distilbert-base-multilingual-cased

Model input samples are tuples of the following format, either assigned to 1 or assigned to 0.

The model was trained for 1 epoch.

Model usage

The cross-encoder model can be used like this:

from sentence_transformers import CrossEncoder
model = CrossEncoder('model_name')
scores = model.predict([('Query 1', 'Paragraph 1'), ('Query 2', 'Paragraph 2')])

The model will predict scores for the pairs ('Query 1', 'Paragraph 1') and ('Query 2', 'Paragraph 2').

For more details on the usage of the cross-encoder models have a look into the Sentence-Transformers

Model Performance:

Model evaluation was done on 2000 evaluation paragraphs of the dataset.

AccuracyF1-ScorePrecisionRecall
89.7086.8286.8293.50

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms