DongsubShim

alignment-handbook

Robust recipes to align language models with human and AI preferences

Humback

🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.

airoboros

Customizable implementation of the self-instruct paper.

WeightWatcher

The WeightWatcher tool for predicting the accuracy of Deep Neural Networks

flash-attention

Fast and memory-efficient exact attention

pyvene

Stanford NLP Python Library for Understanding and Improving PyTorch Models via Interventions

causal-text-papers

Curated research at the intersection of causal inference and natural language processing.

open_llama

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

RedPajama-Data

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

LLMZoo

⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡

LLM-Adapters

Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"

BFP

Pytorch Implementation for "Preserving Linear Separability in Continual Learning by Backward Feature Projection" (CVPR 2023)

awesome-totally-open-chatgpt

A list of totally open alternatives to ChatGPT

Task-Oriented-Dialogue-Research-Progress-Survey

A datasets and methods survey about task-oriented dialogue, including recent datasets and SOTA leaderboards.

toolformer-pytorch

Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI

causallib

A Python package for modular causal inference analysis and model evaluations

EconML

ALICE (Automated Learning and Intelligence for Causation and Economics) is a Microsoft Research project aimed at applying Artificial Intelligence concepts to economic decision making. One of its goals is to build a toolkit that combines state-of-the-art machine learning techniques with econometrics in order to bring automation to complex causal inference problems. To date, the ALICE Python SDK (econml) implements orthogonal machine learning algorithms such as the double machine learning work of Chernozhukov et al. This toolkit is designed to measure the causal effect of some treatment variable(s) t on an outcome variable y, controlling for a set of features x.

dowhy

DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inference, combining causal graphical models and potential outcomes frameworks.

COMET

A Neural Framework for MT Evaluation

prism

MT Evaluation in Many Languages via Zero-Shot Paraphrasing

MT-Evaluation

Machine Translation (MT) Evaluation Scripts

Awesome-Simultaneous-Translation

Paper list of simultaneous translation / streaming translation, including text-to-text machine translation and speech-to-text translation.

MT-Reading-List

A machine translation reading list maintained by Tsinghua Natural Language Processing Group

FLAN

promptsource

Toolkit for creating, sharing and using natural language prompts.

Diff-SCM

Code for Diff-SCM paper

CLS-ER

The official PyTorch code for ICLR'22 Paper "Learning Fast, Learning Slow: A General Continual Learning Method based on Complementary Learning System""

DualNet

AML