IvanYashchuk

carleson

A formalized proof of Carleson's theorem in Lean

mistral-finetune

llama3-from-scratch

llama3 implementation one matrix multiplication at a time

dd-trace-py

Datadog Python APM Client

lightning-thunder

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

mathematics_in_lean

The user home repository for the Mathematics in Lean tutorial.

Transformers_And_LLM_Are_What_You_Dont_Need

The best repository showing why transformers might not be the answer for time series forecasting and showcasing the best SOTA non transformer models.

resource-stream

CUDA related news and material links

lazygit

simple terminal UI for git commands

illustrated-machine-learning.github.io

Website containing illustrations about Machine Learning theory!

mathlib4

The math library of Lean 4

trident

A performance library for machine learning applications.

Essentials-of-Compilation

A book about compiling Racket and Python to x86-64 assembly

CassetteOverlay.jl

An experimental simple method overlay mechanism for Julia

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

auto-walrus

Automatically use the awesome walrus operator

programming-language-research

✨ Programming Language Research, Applied PLT & Compilers

hlb-CIFAR10

Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)

bigscience

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

pythonflow

:snake: Dataflow programming for python.

mesh-transformer-jax

Model parallel transformers in JAX and Haiku

swarm-jax

Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes

pysr_scaling_laws

You should use PySR to find scaling laws. Here's an example.

polysnake

A Python extension module that uses C, C++, Fortran and Rust

mlir-tutorial

MLIR For Beginners tutorial

ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, Phi, MiniCPM, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, GraphRAG, DeepSpeed, vLLM, FastChat, Axolotl, etc.

cs431

advanced-mpi

Advanced MPI and parallel I/O

objgraph

Visually explore Python object graphs

MIRAI

Rust mid-level IR Abstract Interpreter