Why did we open-source our inference engine? Read the post

BAAI/bge-m3 (Score)

For more details please refer to our github repo: https://github.com/FlagOpen/FlagEmbedding

Architecture
XLM-RoBERTa
Parameters
568M
Tasks
Encode
Outputs
Dense, Sparse, Multi-Vec
Dimensions
Dense: 1,024, Sparse: 250,002, Multi-Vec: 1,024
Max Sequence Length
8,192 tokens
License
mit

Benchmarks

CQADupstackPhysicsRetrieval

scientific retrieval en

Duplicate question retrieval from StackExchange Physics

Corpus: 38,314 Queries: 1,039
Performance L4 b1 c16
Corpus 27.0K tok/s
Corpus p50 75.3ms
Query 2.6K tok/s
Query p50 55.2ms
Reference →

CosQA

technology retrieval en

Code search with natural language queries

Corpus: 6,267 Queries: 500
Performance L4 b1 c16
Corpus 13.5K tok/s
Corpus p50 58.4ms
Query 1.5K tok/s
Query p50 57.6ms
Reference →

FiQA2018

finance retrieval en

Financial opinion mining and question answering

Corpus: 57,599 Queries: 648
Performance L4 b1 c16
Corpus 26.8K tok/s
Corpus p50 89.3ms
Query 2.9K tok/s
Query p50 55.8ms
Reference →

LegalBenchConsumerContractsQA

legal retrieval en

Question answering on consumer contracts

Corpus: 153 Queries: 396
Performance L4 b1 c16
Corpus 36.7K tok/s
Corpus p50 224.8ms
Query 3.7K tok/s
Query p50 59.5ms
Reference →

NFCorpus

medical retrieval en

Biomedical literature search from NutritionFacts.org

Corpus: 3,593 Queries: 323
Performance L4 b1 c16
Corpus 34.4K tok/s
Corpus p50 137.4ms
Query 1.2K tok/s
Query p50 56.8ms
Reference →

NanoFiQA2018Retrieval

finance retrieval en

Smaller subset of the FiQA financial QA dataset

Performance L4 b1 c16
Corpus 30.9K tok/s
Corpus p50 86.4ms
Query 2.8K tok/s
Query p50 54.9ms
Reference →

SCIDOCS

scientific retrieval en

Citation prediction, document classification, and recommendation for scientific papers

Corpus: 25,656 Queries: 1,000
Performance L4 b1 c16
Corpus 31.0K tok/s
Corpus p50 101.1ms
Query 2.7K tok/s
Query p50 55.7ms
Reference →

SciFact

scientific retrieval en

Scientific claim verification using research literature

Corpus: 5,183 Queries: 300
Performance L4 b1 c16
Corpus 32.2K tok/s
Corpus p50 126.9ms
Query 3.9K tok/s
Query p50 57.5ms
Reference →

StackOverflowQA

technology retrieval en

Programming question answering from Stack Overflow

Corpus: 19,931 Queries: 1,994
Performance L4 b1 c16
Corpus 29.5K tok/s
Corpus p50 118.6ms
Query 31.5K tok/s
Query p50 147.9ms
Reference →

Self-hosted inference for search & document processing

Cut API costs by 50x, boost quality with 85+ SOTA models, and keep your data in your own cloud.

Github 1.5K

Contact us

Tell us about your use case and we'll get back to you shortly.