mmarius

awesome-finetuning

A curated list of resources on fine-tuning language models.

adapter-transformers

Huggingface Transformers + Adapters = ❤️

AtypicalAnimacy

Repository for code underlying the paper 'Living Machines: A Study of Atypical Animacy' (COLING2020)

BayesianTransferLearning

BIG-bench

Beyond the Imitation Game collaborative benchmark for enormous language models

composable-sft

composer

Supercharge Your Model Training

DPR

Dense Passage Retriever - is a set of tools and models for open domain Q&A task.

dynamic-lm-kb

LM with limited access to KB

edge-of-stability

evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

examples

Fast and flexible reference benchmarks

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

fine-tuning-connectivity

HF-Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

jiant

The jiant toolkit for general-purpose text understanding models

KILT

Library for Knowledge Intensive Language Tasks

language

Shared repository for open-sourced projects from the Google AI Language team.

llm2vec-blogpost

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

mlxtend

A library of extension and helper modules for Python's data analysis and machine learning libraries.

mmarius.github.io

A beautiful, simple, clean, and responsive Jekyll theme for academics

OpenPrompt

An Open-Source Toolkit for Prompt-Learning.

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

pet

This repository contains the code for "How many data points is a prompt worth?"

promptsource

Toolkit for collecting and applying templates of prompting instances

reproduce-finetuning

shortformer

Code for the Shortformer model, from the paper by Ofir Press, Noah A. Smith and Mike Lewis.

t0-analysis

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.