arian-askari

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

arxiv-latex-cleaner

arXiv LaTeX Cleaner: Easily clean the LaTeX code of your paper to submit to arXiv

RL4LMs

A modular RL library to fine-tune language models to human preferences

BERT-related-papers

BERT-related papers

direct-preference-optimization

Reference implementation for DPO (Direct Preference Optimization)

awesome-twitter-data

A list of Twitter datasets and related resources.

attention_sinks

Extend existing LLMs way beyond the original training length with constant memory usage, without retraining

awesome-pretrained-models-for-information-retrieval

A curated list of awesome papers related to pre-trained models for information retrieval (a.k.a., pretraining for IR).

GraphGPT

[SIGIR'2024] "GraphGPT: Graph Instruction Tuning for Large Language Models"

cosmopedia

QuIP

Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"

GenRead

Code and Checkpoints for "Generate rather than Retrieve: Large Language Models are Strong Context Generators" in ICLR 2023.

Knowledge-Grounded-Conversation

A Knowledge Grounded Conversation (KGC) Paper Reading List Maintained by Chuan Meng.

DSI-QG

The official repository for "Bridging the Gap Between Indexing and Retrieval for Differentiable Search Index with Query Generation", Shengyao Zhuang, Houxing Ren, Linjun Shou, Jian Pei, Ming Gong, Guido Zuccon and Daxin Jiang.

RAGElo

RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker

Twitter-Follower-Count

Display the number of followers of Twitter users

DukeNet

Code for SIGIR-2020 full paper: DukeNet: A Dual Knowledge Interaction Network for Knowledge-Grounded Conversation

hagrid

A Human-LLM Collaborative Dataset for Generative Information-seeking with Attribution

RefNet

Code for AAAI-2020 oral paper: RefNet: A Reference-aware Network for Background Based Conversation

reddit_collector

Reddit Collector and Text Processor

MUSER

MANtIS

MANtIS - a multi-domain information seeking dialogues dataset

ranger

Ranger helps you see the forest among the trees - Ranger is an effect-size meta analysis library creating beautiful forest plots!

LLM-Misinfo-QA

This repository contains data and code used for On the Risk of Misinformation Pollution with Large Language Models (EMNLP 2023 Findings).

Wikipedia_TF_IDF_Dataset

Pre-computed IDF stats over all EN Wiki articles

conformal-factual-lm

transformer-vs-bm25

ECIR'22 - How Different are Pre-trained Transformers for Text Ranking? D.Rau et al.

HK-legalGPT

SIP

Code for the CIKM 2023 long paper: System Initiative Prediction for Multi-turn Conversational Information Seeking

bem_score_pytorch

Answer Equivalence BEM score example in PyTorch using Huggingface Tokenizer