robscc

HAMi-core

HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container

HAMi

Heterogeneous AI Computing Virtualization Middleware

gpu-manager

vcuda-controller

k8sSimulator

K8sSim：A Kubernetes cluster simualtor

k8s-vgpu-scheduler

OpenAIOS vGPU device plugin for Kubernetes is originated from the OpenAIOS project to virtualize GPU device memory, in order to allow applications to access larger memory space than its physical capacity. It is designed for ease of use of extended device memory for AI workloads.

gpu-operator

NVIDIA GPU Operator creates/configures/manages GPUs atop Kubernetes

Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

nerdctl

contaiNERD CTL - Docker-compatible CLI for containerd, with support for Compose, Rootless, eStargz, OCIcrypt, IPFS, ...

VictoriaMetrics

VictoriaMetrics: fast, cost-effective monitoring solution and time series database

multus-cni

A CNI meta-plugin for multi-homed pods in Kubernetes

dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

milvus

A cloud-native vector database, storage for next generation AI applications

colima

Container runtimes on macOS (and Linux) with minimal setup

llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

LeetCode-Go

✅ Solutions to LeetCode by Go, 100% test coverage, runtime beats 100% / LeetCode 题解

ollama

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

lws

LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

BladeDISC

BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.

liqo

Enable dynamic and seamless Kubernetes multi-cluster topologies

admiralty

A system of Kubernetes controllers that intelligently schedules workloads across clusters.

virtual-kubelet

Virtual Kubelet is an open source Kubernetes kubelet implementation.

sql-eval

Evaluate the accuracy of LLM generated outputs

ebpf

ebpf-go is a pure-Go library to read, modify and load eBPF programs and attach them to various hooks in the Linux kernel.

kin-openapi

OpenAPI 3.0 (and Swagger v2) implementation for Go (parsing, converting, validation, and more)

nos

Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elastic quotas - Effortless optimization at its finest!

lucene-go

A Go port of Apache Lucene（Go版Lucene）

kwok

Kubernetes WithOut Kubelet - Simulates thousands of Nodes and Clusters.

crane

Crane is a FinOps Platform for Cloud Resource Analytics and Economics in Kubernetes clusters. The goal is not only to help users to manage cloud cost easier but also ensure the quality of applications.

trulens

Evaluation and Tracking for LLM Experiments