farris

llama.cpp

LLM inference in C/C++

llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

AdvPythonProject

DataScienceCourse

This holds iPython notebooks and lecture slides for the Intro to Data Science Master's course I teach at NYU.