Model reference · open weights
bge-reranker-large is an open-weight embedding model from BAAI, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
We have updated the new reranker, supporting larger lengths, more languages, and achieving better performance. More details please refer to our Github: FlagEmbedding. English | 中文 FlagEmbedding focuses on retrieval-augmented LLMs, consisting of the following projects currently: - Long-Context LLM: Activation Beacon - Fine-tuning of LM : LM-Cocktail - Embedding Model: Visualized-BGE, BGE-M3, LLM Embedder, BGE Embedding - Reranker Model: llm rerankers, BGE Reranker - Benchmark: C-MTEB News - 3/18/2024: Release new rerankers, built upon powerful M3 and LLM (GEMMA and MiniCPM, not so large actually) backbones, supporitng multi-lingual processing and larger inputs, massive improvements of ranking performances on BEIR, C-MTEB/Retrieval, MIRACL, LlamaIndex Evaluation. - 3/18/2024: Release Visualized-BGE, equipping BGE with visual capabilities. Visualized-BGE can be utilized to generate embeddings for hybrid image-text data. - 1/30/2024: Release BGE-M3, a new member to BGE model series! M3 stands for Multi-linguality (100+ languages), Multi-granularities (input length up to 8192), Multi-Functionality (unification of dense, lexical, multi-vec/colbert retrieval). It is the first embedding model which supports all three retrieval methods, achieving new SOTA on multi-lingual (MIRACL) and cross-lingual (MKQA) benchmarks. Technical Report and Code. :fire: - 1/9/2024: Release Activation-Beacon, an effective, efficient, compatible, and low-cost (training) method to extend the context length of LLM. Technical Report :fire: - 12/24/2023: Release LLaRA, a LLaMA-7B based dense retriever, leading to state-of-the-art performances on MS MARCO and BEIR. Model and code will be open-sourced. Please stay tuned. Technical Report - 11/23/2023: Release LM-Cocktail, a method to maintain general capabilities during fine-tuning by merging multiple language models. Technical Report :fire: - 10/12/2023: Release LLM-Embedder, a unified embedding model to support diverse retrieval augmentation needs for LLMs. Technical Report - 09/15/2023: The technical report of BGE has been released - 09/15/2023: The massive training data of BGE has been released - 09/12/2023: New models: - New reranker model: re
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | BAAI |
|---|---|
| Type | Embedding models |
| Parameters (lead) | 560M |
| Context | 514 tokens |
| Variants | 1 |
| Runs with | transformers |
| Released | 2023-09-12 |
| Popularity | 2.6M downloads / month |
| Likes | 467 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| bge-reranker-large | 560M | BF16 | ~1.3 GB | ✓ | Weights ↗ |
Benchmarks
As published on the model card — the maker's own numbers, not measured by AxForge.
| Task | Dataset | Metric | Score |
|---|---|---|---|
| Reranking | MTEB CMedQAv1 | map | 81.272 |
| Reranking | MTEB CMedQAv1 | mrr | 84.142 |
| Reranking | MTEB CMedQAv2 | map | 84.104 |
| Reranking | MTEB CMedQAv2 | mrr | 86.794 |
| Reranking | MTEB MMarcoReranking | map | 35.46 |
| Reranking | MTEB MMarcoReranking | mrr | 34.602 |
| Reranking | MTEB T2Reranking | map | 67.277 |
| Reranking | MTEB T2Reranking | mrr | 77.132 |
Using it via the API
Once AxForge deploys bge-reranker-large for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (bge-reranker-large below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/embeddings \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"bge-reranker-large","input":"text to embed"}'
Details
Languages
Tags
Papers
Licence
Open weights under mit — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗
Explore