duanmengkk

Medusa

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

kosmos

The limitless expansion of Kubernetes. Make Kubernetes without boundaries

knavigator

knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

toc

⚖️ The CNCF Technical Oversight Committee (TOC) is the technical governing body of the CNCF Foundation.

milvus

A cloud-native vector database, storage for next generation AI applications

seldon-core

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

ollama

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

OLMo

Modeling, training, eval, and inference code for OLMo

pythia

The hub for EleutherAI's work on interpretability and learning dynamics

transformer-debugger

kube

Rust Kubernetes client and controller runtime

grok-1

Grok open release

kaito

Kubernetes AI Toolchain Operator

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

lws

LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

kueue

Kubernetes-native Job Queueing

ai-infra-landscape

This is a landscape of the infrastructure that powers the generative AI ecosystem

node-problem-detector

This is a place for various problem detectors running on the Kubernetes nodes.

kube-scheduler-wasm-extension

All the things to make the scheduler extendable with wasm.

netdoctor

kubernetes

Production-Grade Container Scheduling and Management

community-infra

kube-safe-scheduler

public-image-mirror

很多镜像都在国外。比如 gcr 。国内下载很慢，需要加速。致力于提供连接全世界的稳定可靠安全的容器镜像服务。

kubegateway

Specific Layer7 Gateway for kube-apiserver

multicluster

CoreDNS plugin implementing K8s multi-cluster services DNS spec.

enhancements

Enhancements tracking repo for Kubernetes

coder-kung-fu

开发内功修炼

process-governor

This application allows you to put various limits on Windows processes.