Ivan Yashchuk's starred repositories
llama3-from-scratch
llama3 implementation one matrix multiplication at a time
dd-trace-py
Datadog Python APM Client
lightning-thunder
Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.
mathematics_in_lean
The user home repository for the Mathematics in Lean tutorial.
Transformers_And_LLM_Are_What_You_Dont_Need
The best repository showing why transformers might not be the answer for time series forecasting and showcasing the best SOTA non transformer models.
resource-stream
CUDA related news and material links
illustrated-machine-learning.github.io
Website containing illustrations about Machine Learning theory!
Essentials-of-Compilation
A book about compiling Racket and Python to x86-64 assembly
CassetteOverlay.jl
An experimental simple method overlay mechanism for Julia
auto-walrus
Automatically use the awesome walrus operator
programming-language-research
✨ Programming Language Research, Applied PLT & Compilers
hlb-CIFAR10
Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)
bigscience
Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
pythonflow
:snake: Dataflow programming for python.
mesh-transformer-jax
Model parallel transformers in JAX and Haiku
pysr_scaling_laws
You should use PySR to find scaling laws. Here's an example.
mlir-tutorial
MLIR For Beginners tutorial
ipex-llm
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, Phi, MiniCPM, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, GraphRAG, DeepSpeed, vLLM, FastChat, Axolotl, etc.
advanced-mpi
Advanced MPI and parallel I/O