bglearning

the-book-of-secret-knowledge

A collection of inspiring lists, manuals, cheatsheets, blogs, hacks, one-liners, cli/web tools and more.

professional-programming

A collection of learning resources for curious software engineers

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

flash-attention

Fast and memory-efficient exact attention

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

pytorch-metric-learning

The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.

BERTopic

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

lit-gpt

Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

OLMo

Modeling, training, eval, and inference code for OLMo

data-oriented-design

A curated list of data oriented design resources.

KeyBERT

Minimal keyword extraction with BERT

towhee

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

NExT-GPT

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

clip-retrieval

Easily compute clip embeddings and build a clip retrieval system with them

pythia

The hub for EleutherAI's work on interpretability and learning dynamics

setfit

Efficient few-shot learning with Sentence Transformers

decord

An efficient video loader for deep learning with smart shuffling that's super easy to digest

lightning-bolts

Toolbox of models, callbacks, and datasets for AI/ML researchers.

advice

A repository of links with advice related to grad school applications, research, phd etc

ALBEF

Code for ALBEF: a new vision-language pre-training method

unlimiformer

Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"

evalplus

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023

csvs-to-sqlite

Convert CSV files into a SQLite database

curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components

ml_collections

ML Collections is a library of Python Collections designed for ML use cases.

fiddle

unmasked_teacher

[ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Models

concept-erasure

Erasing concepts from neural representations with provable guarantees

canals

A component orchestration engine

mdp-playground

A python package to design and debug RL agents.