Shaurya Agarwal's repositories
arrow-ballista
Apache Arrow Ballista Distributed Query Engine
arrow-datafusion-python
Apache Arrow DataFusion Python Bindings
The-Meat-and-Potatoes-of-MLOps
The Meat and Potatoes of MLOps - essentials that make the practice unique compared to XXX-Ops (Dev, Data, Others).
inside-a-data-engine
What's inside a data engine? Let's build one from scratch, for fun (and profit).
arrow-datafusion
Apache Arrow DataFusion SQL Query Engine
arrow-rs
Official Rust implementation of Apache Arrow
chroma
the AI-native open-source embedding database
ClickHouse
ClickHouse® is a free analytics DBMS for big data
comprehensive-rust
This is the Rust course used by the Android team at Google. It provides you the material to quickly teach Rust.
data-engineering-wiki
The best place to learn data engineering. Built and maintained by the data engineering community.
gluten
Gluten: Plugin to Double SparkSQL's Performance
huggingface-diffusers
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
huggingface-transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
jax
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
julia
The Julia Programming Language
llama.cpp
Port of Facebook's LLaMA model in C/C++
meta-llama-llama-recipes
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
meta-llama-llama3
The official Meta Llama 3 GitHub site
papers-we-love
Papers from the computer science community to read and discuss.
rapidsai-cudf
cuDF - GPU DataFrame Library
scipy
SciPy library main repository
scylladb
NoSQL data store using the seastar framework, compatible with Apache Cassandra
state-spaces-mamba
Mamba SSM architecture
tinygrad
You like pytorch? You like micrograd? You love tinygrad! ❤️
upscayl
🆙 Upscayl - Free and Open Source AI Image Upscaler for Linux, MacOS and Windows built with Linux-First philosophy.
vespa
AI + Data, online. https://vespa.ai