ouhenio

LLMs-from-scratch

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

just

🤖 Just a command runner

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

uv

An extremely fast Python package and project manager, written in Rust.

ml-engineering

Machine Learning Engineering Open Book

txtai

💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

StableCascade

Official Code for Stable Cascade

CTranslate2

Fast inference engine for Transformer models

Vim

[ICML 2024] Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model

jepa

PyTorch code and models for V-JEPA self-supervised learning from video.

LayerDiffuse

Transparent Image Layer Diffusion using Latent Transparency

RPG-DiffusionMaster

[ICML 2024] Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs (PRG)

alpaca_eval

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

KnowLM

An Open-sourced Knowledgable Large Language Model Framework.

MeZO

[NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333

llm-app-stack

alpaca_farm

A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.

AnglE

Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard

differential-diffusion

KIVI

KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

intrinsic-lora

Official repo of 𝙄𝙣𝙩𝙧𝙞𝙣𝙨𝙞𝙘 𝙇𝙤𝙍𝘼: 𝘼 𝙂𝙚𝙣𝙚𝙧𝙖𝙡𝙞𝙨𝙩 𝘼𝙥𝙥𝙧𝙤𝙖𝙘𝙝 𝙛𝙤𝙧 𝘿𝙞𝙨𝙘𝙤𝙫𝙚𝙧𝙞𝙣𝙜 𝙆𝙣𝙤𝙬𝙡𝙚𝙙𝙜𝙚 𝙞𝙣 𝙂𝙚𝙣𝙚𝙧𝙖𝙩𝙞𝙫𝙚 𝙈𝙤𝙙𝙚𝙡𝙨, which is previously titled (𝘎𝘦𝘯𝘦𝘳𝘢𝘵𝘪𝘷𝘦 𝘔𝘰𝘥𝘦𝘭𝘴: 𝘞𝘩𝘢𝘵 𝘥𝘰 𝘵𝘩𝘦𝘺 𝘬𝘯𝘰𝘸? 𝘋𝘰 𝘵𝘩𝘦𝘺 𝘬𝘯𝘰𝘸 𝘵𝘩𝘪𝘯𝘨𝘴? 𝘓𝘦𝘵'𝘴 𝘧𝘪𝘯𝘥 𝘰𝘶𝘵!)

3d-shapes

This repository contains the 3D shapes dataset, used in Kim, Hyunjik and Mnih, Andriy. "Disentangling by Factorising." In Proceedings of the 35th International Conference on Machine Learning (ICML). 2018. to assess the disentanglement properties of unsupervised learning methods.

Parameter-Efficient-MoE

Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks

pget

parallel fetch

slow_disentanglement

Towards Nonlinear Disentanglement in Natural Data with Temporal Sparse Coding

disentangling-correlated-factors

A benchmarking suite for disentanglement algorithms, suited for evaluating robustness to correlated factors. Codebase for the paper "Disentanglement of Correlated Factors via Hausdorff Factorized Support" by Karsten Roth, Mark Ibrahim, Zeynep Akata, Pascal Vincent, Diane Bouchacourt.

keyframed

Simple, expressive, pythonic datatypes for manipulating curves parameterized by keyframes and interpolators.

improved-diffusion

Text-writing denoising diffusion (and much more)

gdf