romilbhardwaj

cilantro

Source code for OSDI 2023 paper titled "Cilantro - Performance-Aware Resource Allocation for General Objectives via Online Feedback"

kube-tutorial

Kubernetes Tutorial for the PS2 group meetings at UC Berkeley

escher

ESCHER - Expressive Scheduling with Ephemeral Resources

romilphdthesis

My PhD thesis on resource efficient machine learning

aether

Zero trust storage that shards your data across object stores

chakra

Chakra is a highly customizable Kubernetes scheduler that makes Kubernetes schedule jobs as _you_ want them.

cilantro-workloads

Workloads used in OSDI 2023 paper titled "Cilantro - Performance-Aware Resource Allocation for General Objectives via Online Feedback"

scalable-env-demo

An example using SkyPilot to scale environments for agents

skypilot-catalog

ai-infra-landscape

This is a landscape of the infrastructure that powers the generative AI ecosystem

Awesome-LLM

Awesome-LLM: a curated list of Large Language Model

awesome-production-machine-learning

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

bitsandbytes

8-bit CUDA functions for PyTorch

cloud-preemption-sim

cloudsuite

A Benchmark Suite for Cloud Services.

DeathStarBench

Open-source benchmark suite for cloud microservices

FastChat

An open platform for training, serving, and evaluating large languages. Release repo for Vicuna and FastChat-T5.

FlexGen

Running large language models like OPT-175B/GPT-3 on a single GPU. Focusing on high-throughput generation.

goofys

a high-performance, POSIX-ish Amazon S3 file system written in Go

liveness-bot

A liveness bot that logs the timestamp to a file. Good for checking when your spot instance got killed.

localGPT

Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

meta-fuse-csi-plugin

A CSI plugin for All FUSE implementations

pytorch-distributed-resnet

Example of Pytorch Resnet Distributed Training - pulled from https://leimao.github.io/blog/PyTorch-Distributed-Training/

romilbhardwaj.github.io

My Website

sharedfs-pingpong

Example app that demonstrates communication using a shared file system

skycamp-infra

Tool to provision infrastructure for SkyCamp 2022 tutorials

skypilot

SkyPilot is a framework for easily running machine learning workloads on any cloud through a unified interface.

skypilot-playground

Creates a public playground for people to play with SkyPilot

skypilot-tutorial

smarter-device-manager

Enables k8s containers to access devices (linux device drivers) available on nodes