beir-cellar / beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

Home Page:http://beir.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

recommended pytrec-eval-terrier rather than pytrec-eval

liyongkang123 opened this issue · comments

It is recommended to use pytrec-eval-terrier instead of pytrec-eval.

During the installation of beir, pytrec-eval is required, but this library has not been maintained for 4 years, and installation failures often occur, which in turn causes beir failure.
https://pypi.org/project/pytrec-eval-terrier/#files
It is a substitute for pytrec-eval. I recommend that beir replace the dependency in setup.py