embeddings-benchmark / mteb

MTEB: Massive Text Embedding Benchmark

https://arxiv.org/abs/2210.07316

embeddings-benchmark/mteb Issues

Remove BSARDRetrieval task for French?
Updated 14 days ago3
More code search benchmarks
Updated 15 days ago
pair classification inconsistencies
Updated 15 days ago1
Display languages information in the scoreboard
Updated 15 days ago5
Add sentiment classification datasets as one multilingual task
Closed 15 days ago
Add a Benchmark for African languages
Updated 16 days ago
Language Overview
Updated 16 days ago
Add a Benchmark for Asian Languages
Updated 16 days ago2
Add Lingua Franca Benchmark
Updated 16 days ago
Question/Bug? Double check functionality
Updated 16 days ago2
Add SciRepEval
Updated 17 days ago
Linguistic Probing and New Task
Closed 17 days ago2
Making ScalaClassification multilingual
Updated 17 days ago5
Convert French Clustering tasks to Fast
Updated 19 days ago
Multilayer/Hiarchical Clustering
Updated 20 days ago2
Slow loading for datasets with a high number of language pairs
Updated 21 days ago10
Tests failing due to not found datasets
Closed 21 days ago5
Automatically review TaskMetadata Fields in PRs
Closed 21 days ago11
Make MLSUM a multilingual task
Closed 21 days ago
Issues with stratified_subsampling()
Updated 21 days ago3
Add MLQA CrossLingual Retrieval dataset
Updated 21 days ago
Add swiss judgements
Updated 22 days ago1
Multiple label annotated datasets
Updated 22 days ago8
Some datasets for languages.
Updated 22 days ago3
Point tracking always introduces merge conflicts.
Closed 22 days ago2
Update task table CI job infinite loop
Closed 22 days ago9
CI fails unexpectedly
Updated 22 days ago2
Update previous tasks and scores using new subsampling function
Closed 22 days ago
scale Italian HateSpeech to multilingual
Closed 22 days ago
Subsampling function removes train split from dataset
Closed 23 days ago4
Add helper function to unify how we subsample data
Closed 23 days ago5
Transitioning to a faster MTEB
Updated 23 days ago5
Adding FQUAD for French Retrieval
Closed 23 days ago2
DenseRetrievalExactSearch is too narrow for the general retrieval model class
Updated 24 days ago
duplicate examples in TwentyNewsgroupsClustering
Updated 24 days ago3
What about a Cross-lingual Retrieval task?
Closed 25 days ago2
Scalable dataset generation with Wikipedia (for mid/low resource languages)
Updated 25 days ago12
specify model interfaces
Updated a month ago
Ci fails on windows
Updated a month ago
Design choices for adding rerankers/cross-encoders
Updated a month ago8
Fix split name of AlloprofRetrieval and SyntecRetrieval
Closed a month ago1
Instructions for loading a local dataset
Closed a month ago1
Add a multilabel classification task
Updated a month ago1
EstQA contains multiple ids for the same context document
Closed a month ago2
run_mteb_german.py throws errors at Retrival tasks
Closed a month ago1
Speeding up MTEB
Updated a month ago
Fix MLSUM S2S and P2P tasks
Closed a month ago1
Add HunSum-1 Dataset
Closed a month ago1
How does MTEB handle truncation in embedding models?
Updated a month ago2
Tracking down dataset duplication
Updated a month ago1