dkozlov

frp

A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.

rustdesk

An open-source remote desktop, and alternative to TeamViewer.

evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

temporal

Temporal service

pyroscope

Continuous Profiling Platform. Debug performance issues down to a single line of code

livekit

End-to-end stack for WebRTC. SFU media server and SDKs.

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

cleanrl

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

MobileSAM

This is the official code for MobileSAM project that makes SAM lightweight for mobile applications and beyond!

kaggle-solutions

🏅 Collection of Kaggle Solutions and Ideas 🏅

llm-foundry

LLM training code for Databricks foundation models

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

storj

Ongoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.

Pearl

A Production-ready Reinforcement Learning AI Agent Library brought by the Applied Reinforcement Learning team at Meta.

Dragonfly2

Dragonfly is an open source P2P-based file distribution and image acceleration system. It is hosted by the Cloud Native Computing Foundation (CNCF) as an Incubating Level Project.

instill-core

🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications

Stable-Diffusion-WebUI-TensorRT

TensorRT Extension for Stable Diffusion Web UI

beyla

eBPF-based autoinstrumentation of web applications and network metrics

nydus

Nydus - the Dragonfly image service, providing fast, secure and easy access to container images.

stargz-snapshotter

Fast container image distribution plugin with lazy pulling

streaming

A Data Streaming Library for Efficient Neural Network Training

optimum-nvidia

perftest

Infiniband Verbs Performance Tests

soci-snapshotter

A containerd snapshotter plugin which enables standard OCI images to be lazily loaded without requiring a build-time conversion step.

versatile-data-kit

One framework to develop, deploy and operate data workflows with Python and SQL.

SUOD

(MLSys' 21) An Acceleration System for Large-scare Unsupervised Heterogeneous Outlier Detection (Anomaly Detection)

maas

Official MAAS repository mirror (may be out of date). Development happens in Launchpad (https://git.launchpad.net/maas/).

warewulf

Warewulf is a stateless and diskless container operating system provisioning system for large clusters of bare metal and/or virtual systems.

zero-bubble-pipeline-parallelism

Zero Bubble Pipeline Parallelism

jobset

JobSet: An API for managing a group of Jobs as a unit