Tianjian Li's starred repositories
pytorch-lightning
Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
OpenNMT-py
Open Source Neural Machine Translation and (Large) Language Models in PyTorch
direct-preference-optimization
Reference implementation for DPO (Direct Preference Optimization)
TransformerLens
A library for mechanistic interpretability of GPT-style language models
dont-stop-pretraining
Code associated with the Don't Stop Pretraining ACL 2020 paper
pytorch_influence_functions
This is a PyTorch reimplementation of Influence Functions from the ICML2017 best paper: Understanding Black-box Predictions via Influence Functions by Pang Wei Koh and Percy Liang.
cartography
Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics
Tk-Instruct
Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
Gradient_Starvation
Gradient Starvation: A Learning Proclivity in Neural Networks
InstructMT
A collection of instruction data and scripts for machine translation.
ParetoMNMT
Source code for paper "On the Pareto Front of Multilingual Neural Machine Translation" @ NeurIPS 2023
Integer_Addition
✱ Understanding the underlying learning dynamics of simple tasks in Transformer networks