proger

awesome-cold-showers

For when people get too hyped up about things

CopilotKit

A framework for building custom AI Copilots 🤖 in-app AI chatbots, in-app AI Agents, & AI-powered Textareas.

act-plus-plus

Imitation learning algorithms with Co-training for Mobile ALOHA: ACT, Diffusion Policy, VINN

audio2photoreal

Code and dataset for photorealistic Codec Avatars driven from audio

likwid

Performance monitoring and benchmarking suite

resource-stream

CUDA related news and material links

ontology

The Audio Set Ontology aims to provide a comprehensive set of categories to describe sound events.

specialist

Visualize CPython's specializing, adaptive interpreter. :fire:

m2

Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"

flash-linear-attention

Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton

Fuser

A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")

PegasusSimulator

A framework built on top of NVIDIA Isaac Sim for simulating drones with PX4 support and much more

multipack_sampler

Multipack distributed sampler for fast padding-free training of LLMs

llm-random

zoology

Understand and test language model architectures on synthetic tasks.

peS2o

Pretraining Efficiently on S2ORC!

parameterfree

Parameter-Free Optimizers for Pytorch

torch-discounted-cumsum

Fast Discounted Cumulative Sums in PyTorch

swarms-pytorch

Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊

deel-lip

Build and train Lipschitz constrained networks: TensorFlow implementation of k-Lipschitz layers

moe_attention

Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"

life-of-a-numba-kernel

Worked example of the process from Python source to CUDA kernel execution with Numba

pscan

deel-torchlip

Build and train Lipschitz-constrained networks: PyTorch implementation of 1-Lipschitz layers. For TensorFlow/Keras implementation, see https://github.com/deel-ai/deel-lip

ZerAuCap

[NeurIPS 2023 - ML for Audio Workshop (Oral)] Zero-shot audio captioning with audio-language model guidance and audio context keywords

gps-ssl

Guided Nearest Neighbor Contrastive Learning

ptx-kernels

Some side by side comparisons of simple CUDA kernels written in pure inline PTX.

metaprompting

For the paper "On Meta-Prompting"

message-store

Message store implementation in python

pinn-air

PINNAir: Physics-Informed Neural Network for Multirotor Slung Load Systems Modeling