seanmacavaney

clpsych2021-shared-task

OpenNIR

An end-to-end neural ad-hoc ranking pipeline.

ColBERT

ColBERT: Contextualized Late Interaction over BERT (code for SIGIR'20 paper)

irds_robust_anserini

pushshift-reddit-sync

A simple utility to sync a local copy of the pushshift.io Reddit submission and comment dumps

pyterrier_doc2query

trello-track

Tracks running processes via Trello

beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

bert-axioms

Code for ECIR'20 paper Diagnosing BERT with Retrieval Heuristics

capreolus

A toolkit for end-to-end neural ad hoc retrieval

cedr

Code for CEDR: Contextualized Embeddings for Document Ranking, accepted at SIGIR 2019.

cpython

The Python programming language

cwl

An evaluation script based on the C/W/L framework that is TREC Compatible and provides a replacement for TREC_EVAL and independent scripts for INST, RBP, TBG and U-Measure, etc. All measurements are reported in the same units making all metrics directly comparable.

datasets

🤗 The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation tools

DL-Hard

Deep Learning Hard (DL-HARD) is a new annotated dataset extending TREC Deep Learning benchmark.

dummy-irds-ext

GenderBias_IR

Tools and resources for measuring gender bias in Information Retrieval models

ir_datasets

Provides a common interface to many IR ranking datasets.

irds-misc

miscelleanous files related to datasets in IR

MSMARCO-Passage-Ranking

MS MARCO(Microsoft Machine Reading Comprehension) is a large scale dataset focused on machine reading comprehension, question answering, and passage ranking. A variant of this task will be the part of TREC and AFIRM 2019. For Updates about TREC 2019 please follow This Repository Passage Reranking task Task Given a query q and a the 1000 most relevant passages P = p1, p2, p3,... p1000, as retrieved by BM25 a succeful system is expected to rerank the most relevant passage as high as possible. For this task not all 1000 relevant items have a human labeled relevant passage. Evaluation will be done using MRR

pisa

PISA: Performant Indexes and Search for Academia

pyterrier_ance

pyterrier_colbert

pytrec_eval

pytrec_eval is an Information Retrieval evaluation tool for Python, based on the popular trec_eval.

s4s

terrier-core

Terrier IR Platform

test

trec-car-tools

Tools for working with the TREC CAR dataset.

TREC-COVID

TREC-COVID results

warc3-clueweb

Python 3 library for reading and writing warc files