xwhan

llama

Inference code for LLaMA models

chatgpt-retrieval-plugin

The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.

evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

alphafold

Open source code for AlphaFold.

FlexGen

Running large language models on a single GPU for throughput-oriented scenarios.

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

point-e

Point cloud diffusion for 3D model synthesis

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

fairscale

PyTorch extensions for high performance and large scale training.

rebiber

A simple tool to update bib entries with their official information (e.g., DBLP or the ACL anthology).

DPR

Dense Passage Retriever - is a set of tools and models for open domain Q&A task.

hh-rlhf

Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"

deduplicate-text-datasets

NL-Augmenter

NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations

DensePhrases

[ACL 2021] Learning Dense Representations of Phrases at Scale; EMNLP'2021: Phrase Retrieval Learns Passage Retrieval, Too https://arxiv.org/abs/2012.12624

torchprofile

A general and accurate MACs / FLOPs profiler for PyTorch models

attention_with_linear_biases

Code for the ALiBi method for transformer language models (ICLR 2022)

llm_training_handbook

An open collection of methodologies to help with successful training of large language models.

mega

Sequence modeling with Mega.

multihop_dense_retrieval

Multi-hop dense retrieval for question answering

gooaq

Question-answers, collected from Google

bart-closed-book-qa

A BART version of an open-domain QA model in a closed-book setup

deformer

[ACL 2020] DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering

3DILG

3DILG: Irregular Latent Grids for 3D Generative Modeling

demix

DEMix Layers for Modular Language Modeling

qasper-led-baseline

Baleen

Baleen: Robust Multi-Hop Reasoning at Scale via Condensed Retrieval (NeurIPS'21)

BookQA

BookQA