HeGaoYuan

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

ColossalAI

Making large AI models cheaper, faster and more accessible

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

gradio

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

jumpserver

An open-source PAM tool alternative to CyberArk. 广受欢迎的开源堡垒机。

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

langflow

⛓️ Langflow is a dynamic graph where each node is an executable unit. Its modular and interactive design fosters rapid experimentation and prototyping, pushing hard on the limits of creativity.

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

alluxio

Alluxio, data orchestration for analytics and machine learning in the cloud

skypilot

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

kserve

Standardized Serverless ML Inference Platform on Kubernetes

redsync

Distributed mutual exclusion lock using Redis for Go

ContainerSSH

ContainerSSH: Launch containers on demand

multus-cni

A CNI meta-plugin for multi-homed pods in Kubernetes

Chinese-Llama-2-7b

开源社区第一个能下载、能运行的中文 LLaMA2 模型！

fluid

Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud. (Project under CNCF)

kubectl-ai

✨ Kubectl plugin for OpenAI GPT

deep-learning-containers

AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in TensorFlow, TensorFlow 2, PyTorch, and MXNet.

sematic

An open-source ML pipeline development platform

mosec

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

diffusion

perftest

Infiniband Verbs Performance Tests

kubectl-debug

Debug a target container in a Kubernetes cluster by automatically creating a new, non-invasive, 'debug' container in the same pid, network, user, and ipc namespace as the target container without disrupting the target container. The new container may contain all the troubleshooting tools utilites you require, even if the target container doesn't even contain a SHELL.

nv_peer_memory

k8s-rdma-shared-dev-plugin

kubernetes-controller-sharding

Horizontally Scalable Kubernetes Controllers: distribute reconciliation of Kubernetes objects across multiple controller instances