Skip to content
Why did we open-source our inference engine? Read the post

Reranker Models

ModelMax LengthNotes
BAAI/bge-reranker-v2-m38192Multilingual
jinaai/jina-reranker-v2-base-multilingual1024Multilingual
Alibaba-NLP/gte-reranker-modernbert-base8192ModernBERT architecture
cross-encoder/ms-marco-MiniLM-L-12-v2512Smaller, faster

See Full model catalog for the complete list.

English only:

  • BAAI/bge-reranker-base, BAAI/bge-reranker-large
  • cross-encoder/ms-marco-MiniLM-L-6-v2, cross-encoder/ms-marco-MiniLM-L-12-v2

Multilingual (100+ languages):

  • BAAI/bge-reranker-v2-m3
  • jinaai/jina-reranker-v2-base-multilingual
  • jinaai/jina-colbert-v2

Short context (512 tokens):

  • BAAI/bge-reranker-base, BAAI/bge-reranker-large
  • cross-encoder/ms-marco-MiniLM-L-*
  • colbert-ir/colbertv2.0, mixedbread-ai/mxbai-colbert-large-v1

Medium context (1024 tokens):

  • jinaai/jina-reranker-v2-base-multilingual

Long context (8192 tokens):

  • BAAI/bge-reranker-v2-m3
  • Alibaba-NLP/gte-reranker-modernbert-base
  • mixedbread-ai/mxbai-rerank-base-v2, mixedbread-ai/mxbai-rerank-large-v2
  • jinaai/jina-colbert-v2, lightonai/GTE-ModernColBERT-v1, lightonai/Reason-ModernColBERT

Compact (fast inference):

  • cross-encoder/ms-marco-MiniLM-L-6-v2 - smallest cross-encoder
  • mixedbread-ai/mxbai-edge-colbert-v0-32m - 32M parameters
  • answerdotai/answerai-colbert-small-v1 - compact ColBERT

Large (higher capacity):

  • BAAI/bge-reranker-large
  • mixedbread-ai/mxbai-rerank-large-v2
  • mixedbread-ai/mxbai-colbert-large-v1
  • lightonai/Reason-ModernColBERT - long context (8192), ModernBERT family

The best reranker for your workload is the one that wins on your data. See Evals for how to measure quality and performance, and the retrieval-ablation example in the SIE repository for a complete benchmark comparing rerankers and retrieval strategies end to end:

cd examples/retrieval-ablation
uv sync
# Validate config (no GPU needed)
uv run python benchmark_ablation.py --dry-run

Contact us

Tell us about your use case and we'll get back to you shortly.