sashank06

LLMs-from-scratch

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

dolma

Data and tools for generating and inspecting OLMo pre-training data.

OLMo

Modeling, training, eval, and inference code for OLMo

mlx-examples

Examples in the MLX framework

engineering-blogs

A curated list of engineering blogs

Sophia

The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”

llama.cpp

LLM inference in C/C++

esm

Evolutionary Scale Modeling (esm): Pretrained language models for proteins

RL4LMs

A modular RL library to fine-tune language models to human preferences

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

diffuzers

a web ui & api for 🤗 diffusers

alexa-teacher-models

prize

A prize for finding tasks that cause large language models to show inverse scaling

dalle-mini

DALL·E Mini - Generate images from a text prompt

duelnlg

Code for ACL 2022 Paper: Active Evaluation: Efficient NLG Evaluation with Few Pairwise Comparisons

Berkeley-Crossword-Solver

ACL 2022

metaseq

Repo for external large-scale work

FaithDial

sdsl-lite

Succinct Data Structure Library 2.0

SEAL

Search Engines with Autoregressive Language models

notebooks

Jupyter notebooks for the Natural Language Processing with Transformers book

grafog

Graph Data Augmentation Library for PyTorch Geometric

Converse

GEM-metrics

Automatic metrics for GEM tasks

CodeGen

CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

raph

RAPH - Reinforcement Agent Playing netHack

autoascend

The first place solution for the NeurIPS 2021 Nethack Challenge -- https://www.aicrowd.com/challenges/neurips-2021-the-nethack-challenge

Machine-Learning-Interviews

This repo is meant to serve as a guide for Machine Learning/AI technical interviews.