Alexey Zemtsov's starred repositories
scattermoe
Triton-based implementation of Sparse Mixture of Experts.
hindsight-experience-replay
This is the pytorch implementation of Hindsight Experience Replay (HER) - Experiment on all fetch robotic environments.
schedule_free
Schedule-Free Optimization in PyTorch
euler-scheduler
My implementation Diffusers-like Scheduler for performing Euler Method on Conditional Flow Matching models
Elastic-DT
[NeurIPS 2023] Implementation of Elastic Decision Transformer
Reinformer
Official code for ICML 2024 paper Reinformer: Max-Return Sequence Modeling for offline RL
long-range-arena
Long Range Arena for Benchmarking Efficient Transformers
flash-linear-attention
Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton
LLMTest_NeedleInAHaystack
Doing simple retrieval from LLM models at various context lengths to measure accuracy
deepmind-research
This repository contains implementations and illustrative code to accompany DeepMind publications
tensorneat
GPU-accelerated NeuroEvolution of Augmenting Topologies (NEAT)
ThunderKittens
Tile primitives for speedy kernels
memory-maze
Evaluating long-term memory of reinforcement learning algorithms
s5-pytorch
Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)
flash-attention-jax
Implementation of Flash Attention in Jax