BojanFaletic

AgentLite

tpu-starter

Everything you want to know about Google Cloud TPU

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

Sophia

Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.

deep_learning_curriculum

Language model alignment-focused deep learning curriculum

StableLM

StableLM: Stability AI Language Models

lollms-webui

Lord of Large Language Models Web User Interface

kinda-llama

An open-source replication and extension of the Meta AI's LLAMA dataset

FlexGen

Running large language models on a single GPU for throughput-oriented scenarios.

WebChatRWKVstic

ChatGPT-like Web UI for RWKVstic

tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.

mm-cot

Official implementation for "Multimodal Chain-of-Thought Reasoning in Language Models" (stay tuned and more will be updated)

vall-e

An unofficial PyTorch implementation of the audio LM VALL-E

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

Enzyme

High-performance automatic differentiation of LLVM and MLIR.

pytorch_forward_forward

Implementation of Hinton's forward-forward (FF) algorithm - an alternative to back-propagation

PatchTST

An offical implementation of PatchTST: "A Time Series is Worth 64 Words: Long-term Forecasting with Transformers." (ICLR 2023) https://arxiv.org/abs/2211.14730

edm

Elucidating the Design Space of Diffusion-Based Generative Models (EDM)

kernl

Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

irem_code_release

ICML 2022: Learning Iterative Reasoning through Energy Minimization

Mega-pytorch

Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

simplerecon

[ECCV 2022] SimpleRecon: 3D Reconstruction Without 3D Convolutions

sygil-webui

Stable Diffusion web UI

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

Next-ViT

CodeRL

This is the official code for the paper CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning (NeurIPS22).