Snowflake/snowflake-arctic-embed-m-v2.0
Snowflake's Arctic-embed-m-v2.0
Overview
Benchmarks
CQADupstackPhysicsRetrieval
Duplicate question retrieval from StackExchange Physics
Corpus: 38,314 Queries: 1,039
Quality
map at 10 0.4509
mrr at 10 0.5118
ndcg at 10 0.5097
CosQA
Code search with natural language queries
Corpus: 6,267 Queries: 500
Quality
map at 10 0.2852
mrr at 10 0.3143
ndcg at 10 0.3667
FiQA2018
Financial opinion mining and question answering
Corpus: 57,599 Queries: 648
Quality
map at 10 0.1979
mrr at 10 0.3115
ndcg at 10 0.2535
LegalBenchConsumerContractsQA
Question answering on consumer contracts
Corpus: 153 Queries: 396
Quality
map at 10 0.7503
mrr at 10 0.7516
ndcg at 10 0.8020
NFCorpus
Biomedical literature search from NutritionFacts.org
Corpus: 3,593 Queries: 323
Quality
ndcg at 10 0.2489
map at 10 0.0855
mrr at 10 0.4244
SCIDOCS
Citation prediction, document classification, and recommendation for scientific papers
Corpus: 25,656 Queries: 1,000
Quality
map at 10 0.0271
mrr at 10 0.0911
ndcg at 10 0.0522
SciFact
Scientific claim verification using research literature
Corpus: 5,183 Queries: 300
Quality
map at 10 0.6203
mrr at 10 0.6366
ndcg at 10 0.6631
StackOverflowQA
Programming question answering from Stack Overflow
Corpus: 19,931 Queries: 1,994
Quality
map at 10 0.8903
mrr at 10 0.8903
ndcg at 10 0.9068