snehasinghania

MS-MARCO-Web-Search

A large-scale information-rich web dataset, featuring millions of real clicked query-document labels

llm2vec

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

book-nlp

Natural language processing pipeline for book-length documents (archival Java version; for current Python version, see: https://github.com/booknlp/booknlp)

self-rag

This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.

Virtual-File-System

A simple virtual file system written in C++

booknlp

BookNLP, a natural language processing pipeline for books

FlexGen

Running large language models on a single GPU for throughput-oriented scenarios.

imbalanced-learn

A Python Package to Tackle the Curse of Imbalanced Datasets in Machine Learning

makemore

An autoregressive character-level language model for making more things

metaseq

Repo for external large-scale work

mend

MEND: Fast Model Editing at Scale

kglm-model

Code for KGLM paper

prompt-tuning

Original Implementation of Prompt Tuning from Lester, et al, 2021

x-transformers

A simple but complete full-attention transformer with a set of promising experimental features from various papers

LPAQA

Language model Prompt And Query Archive

few-shot-learning

Few-shot Learning of GPT-3

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

ALPS_2021

XAI Tutorial for the Explainable AI track in the ALPS winter school 2021

the-pile

nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

simpletransformers

Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI

lit

The Learning Interpretability Tool: Interactively analyze ML models to understand their behavior in an extensible and framework agnostic interface.

LAMA

LAnguage Model Analysis

Interactive_Tools

Interactive Tools for Machine Learning, Deep Learning and Math

awesome-papers

Papers & presentation materials from Hugging Face's internal science day

stanza

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

MITIE

MITIE: library and tools for information extraction

wikidata-graph-builder

Visualize Wikidata items using d3.js

Question-Generation

Generating multiple choice questions from text using Machine Learning.

Question-Generation-Paper-List

A summary of must-read papers for Neural Question Generation (NQG)