Shengyao Zhuang's repositories
DSI-transformers
A huggingface transformers implementation of "Transformer Memory as a Differentiable Search Index"
LLM4IR-Survey
This is the repo for the survey of LLM4IR.
anserini
Anserini is a Lucene toolkit for reproducible information retrieval research
arvinzhuang.github.io
Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes
arxivscraper
A python module to scrape arxiv.org for specific date range and categories
character-bert
Main repository for "CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters"
COIL
NAACL2021 - COIL Contextualized Lexical Retriever
DL-Hard
Deep Learning Hard (DL-HARD) is a new annotated dataset extending TREC Deep Learning benchmark.
markdown_readme
Markdown - you can mark up titles, lists, tables, etc., in a much cleaner, readable and accurate way if you do it with HTML.
MSMARCO-Document-Ranking-Submissions
Submission archive for the MS MARCO document ranking leaderboard
MSMARCO-Passage-Ranking
MS MARCO(Microsoft Machine Reading Comprehension) is a large scale dataset focused on machine reading comprehension, question answering, and passage ranking. A variant of this task will be the part of TREC and AFIRM 2019. For Updates about TREC 2019 please follow This Repository Passage Reranking task Task Given a query q and a the 1000 most relevant passages P = p1, p2, p3,... p1000, as retrieved by BM25 a succeful system is expected to rerank the most relevant passage as high as possible. For this task not all 1000 relevant items have a human labeled relevant passage. Evaluation will be done using MRR
natural-questions
Natural Questions (NQ) contains real user questions issued to Google search, and answers found from Wikipedia by annotators. NQ is designed for the training and evaluation of automatic question answering systems.
pygaggle
a gaggle of deep neural architectures for text ranking and question answering, designed for Pyserini
pyserini
Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
pyterrier
A Python framework for performing information retrieval experiments, building on http://terrier.org/
pytorch-lightning
The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.
relevation
Information Retrieval Relevance Judging System
Reranker
Build Text Rerankers with Deep Language Models
sentence-transformers
Multilingual Sentence & Image Embeddings with BERT
stanford_alpaca
Code and documentation to train Stanford's Alpaca models, and generate the data.
tevatron
Tevatron - A flexible toolkit for dense retrieval research and development.
transformers
🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
trl
Train transformer language models with reinforcement learning.
tydiqa
TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and without the use of translation, and is designed for the training and evaluation of automatic question answering systems. This repository provides evaluation code and a baseline system for the dataset.