Model reference · open weights

JaColBERTv2.4

Embeddings answerdotai Embeddings 1 build Open weights 76 dl/mo

JaColBERTv2.4 is an open-weight embedding model from answerdotai. JaColBERTv2.4 (FP32) weighs 223 MB; the smallest configuration that runs it is RTX 3060 12 GB.

What it is

Released byanswerdotai
TypeEmbedding models
TaskEmbeddings
Parameters (lead)111M
Context512 tokens
Runs withRAGatouille
Based oncl-tohoku/bert-base-japanese-v3, bclavie/JaColBERT
Released2024-07-25
Popularity76 downloads / month
Weights223 MB (JaColBERTv2.4 (FP32), file size)
LicenceOpen weights

What it runs on

Memory and cards for JaColBERTv2.4 (FP32)

Weights 223 MB (file size) · overhead about 1.1 GB.

CardRunsCounted
memory
RTX 3060 12 GBfits11.6 GB
RTX 4060 Ti 16 GBfits15.4 GB
RTX 3090 24 GBfits23.4 GB
RTX 4090 24 GBfits23.4 GB
RTX 5090 32 GBfits31.0 GB
L40S 48 GBfits44.0 GB
A100 80 GBfits78.2 GB
H100 80 GBfits78.1 GB
RTX PRO 6000 Blackwell 96 GBfits93.8 GB
DGX Spark (GB10) 128 GB unifiedfits107 GB
H200 141 GBfits138 GB
B200 180 GBfits176 GB

Estimates, not measurements: the weights are the build's file size. No cache grows with use; a batch of inputs needs working memory of its own. Counted memory is 92 % of what CUDA reports for the card.

From the model card

What answerdotai says about JaColBERTv2.4

Model weights for the JaColBERTv2.4 checkpoint, which is the pre-post-training version of JaColBERTv2.5, using an entirely overhauled training recipe and trained on just 40% of the data of JaColBERTv2.

This model largely outperforms all previous approaches, including JaColBERTV2 multilingual models such as BGE-M3, on all datasets.

This page will be updated with the full details and the model report in the next few days.

@misc{clavié2024jacolbertv25optimisingmultivectorretrievers,
      title={JaColBERTv2.5: Optimising Multi-Vector Retrievers to Create State-of-the-Art Japanese Retrievers with Constrained Resources},
      author={Benjamin Clavié},
      year={2024},
      eprint={2407.20750},
      archivePrefix={arXiv},
      primaryClass={cs.IR},
      url={https://arxiv.org/abs/2407.20750},
}

Quoted from the model card on Hugging Face — the full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms