Jakub's starred repositories
Stirling-PDF
#1 Locally hosted web application that allows you to perform various operations on PDF files
llama-recipes
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
RAGatouille
Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.
fsdp_qlora
Training LLMs with QLoRA + FSDP
Gradient-Free-Optimizers
Simple and reliable optimization with local, global, population-based and sequential techniques in numerical discrete search spaces.
ring-attention-pytorch
Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
torchmd-net
Training neural network potentials
qpbenchmark
Benchmark for quadratic programming solvers available in Python
circuitsim
Implementing a full-on electronic circuit simulator, studying the whole concept and physics behind it!
SAC-pytorch
Implementation of Soft Actor Critic and some of its improvements in Pytorch
classic-fpga
basic simulations of digital electronics using vhdl