mananshah99

imessage-exporter

Export iMessage data + run iMessage Diagnostics

card-web

The web app behind thecompendium.cards

py-spy

Sampling profiler for Python programs

diagrams

:art: Diagram as Code for prototyping cloud system architectures

libbacktrace

A C library that may be linked into a C/C++ program to produce symbolic backtraces

anynp

Proof-of-concept of global switching between numpy/jax/pytorch in a library.

unitycatalog

Open, Multi-modal Catalog for Data & AI

kubectx

Faster way to switch between clusters and namespaces in kubectl

kubernetes

Production-Grade Container Scheduling and Management

color

engineering-blogs

A curated list of engineering blogs

How_to_optimize_in_GPU

This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.

How_to_optimize_in_GPU

This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.

llama_duo

asynchronous/distributed speculative evaluation for llama3

go

The Go programming language

ucall

Web Serving and Remote Procedure Calls at 50x lower latency and 70x higher bandwidth than FastAPI, implementing JSON-RPC & REST over io_uring ☎️

liburing

Library providing helpers for the Linux kernel io_uring support

pt-three-ways

Path tracing, done three ways

tiny-gpu

A minimal GPU design in Verilog to learn how GPUs work from the ground up

attorch

A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.

gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.

whispercpp

Pybind11 bindings for Whisper.cpp

bark.cpp

Suno AI's Bark model in C/C++ for fast text-to-speech

shouldersOfGiants.rs

I have no idea what I'm doing , but llm.c in rust

llm.c

LLM training in simple, raw C/CUDA

ShallowSpeed

Small scale distributed training of sequential deep learning models, built on Numpy and MPI.

baidu-allreduce

PytorchBridge

Designing bridge trusses with Pytorch autograd

simdjson

Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks

awesome-distributed-system-projects

🚀 List of distributed system projects for inspiration and learning to build distributed services from real world examples