pjlintw

zett

Code for Zero-Shot Tokenizer Transfer

arxiv-latex-cleaner

arXiv LaTeX Cleaner: Easily clean the LaTeX code of your paper to submit to arXiv

gritlm

Generative Representational Instruction Tuning

xmtf

Crosslingual Generalization through Multitask Finetuning

DeepSpeedExamples

Example models using DeepSpeed

petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

vec2text

utilities for decoding deep representations (like sentence embeddings) back to text

ml-engineering

Machine Learning Engineering Open Book

masakhane-mt

Machine Translation for Africa

parameter-efficient-moe

coli-thesis-template

a basic bachelor's / master's thesis template for language science and technology (LST / CoLi)

InstructCTG

Code for Paper "Controlled Text Generation with Natural Language Instructions"

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

that_is_good_data

prefix-propagation

Code for prefix-propagation (ACL 2023 paper)

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

mtt-distillation

Official code for our CVPR '22 paper "Dataset Distillation by Matching Training Trajectories"

t5x

An-Information-theoretic-Metric-of-Transferability

This repository contains the codes of the experiments in Paper An Information-theoretic Metric of Transferability for Task Transfer Learning

CLaT

Conference-Acceptance-Rate

Acceptance rates for the major AI conferences

cockpit

Cockpit: A Practical Debugging Tool for Training Deep Neural Networks

T2T-ViT

ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet

compacter

awesome-ai-residency

List of AI Residency Programs

google-research

Google Research

self-training-text-generation

Implementation of ICLR 2020 paper "Revisiting Self-Training for Neural Sequence Generation"

efficient-task-transfer

Research code for "What to Pre-Train on? Efficient Intermediate Task Selection", EMNLP 2021

Crisscrossed-Captions

Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO

ATTEMPT

This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)