yeahdongcn

haystack

:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

vllm_nvext

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

volcano

A Cloud Native Batch System (Project under CNCF)

network-operator

Mellanox Network Operator

bocker

Docker implemented in around 100 lines of bash

instill-core

🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications

TaskWeaver

A code-first agent framework for seamlessly planning and executing data analytics tasks.

AI4Animation

Bringing Characters to Life with Computer Brains in Unity

ChatTTS

ChatTTS is a generative speech model for daily dialogue.

Fooocus

Focus on prompting and generating

libra

LIBRA: Enabling Workload-aware Multi-dimensional Network Topology Optimization for Distributed Training of Large AI Models

ns3-rdma

NS3 simulator for RDMA over Converged Ethernet v2 (RoCEv2), including the implementation of DCQCN, TIMELY, PFC, ECN and shared buffer switch

FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving

taipy

Turns Data and AI algorithms into production-ready web applications in no time.

kueue

Kubernetes-native Job Queueing

scheduler-plugins

Repository for out-of-tree scheduler plugins based on scheduler framework.

skaffold

Easy and Repeatable Kubernetes Development

cri

containerd

An open and reliable container runtime

farfalle

🔍 AI search engine - self-host with local or cloud LLMs

anything-llm

The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.

parakeet

🦜🪺 Parakeet is a GoLang library, made to simplify the development of small generative AI applications with Ollama 🦙.

setup-go

Set up your GitHub Actions workflow with a specific version of Go

TiDBOverRoCE

iTerm2

iTerm2 is a terminal emulator for Mac OS X that does amazing things.

crayeye

Multimodal LLM visual analysis multitool

omniplex

Open-Source Perplexity

codel

✨ Fully autonomous AI Agent that can perform complicated tasks and projects using terminal, browser, and editor.

ppsspp

A PSP emulator for Android, Windows, Mac and Linux, written in C++. Want to contribute? Join us on Discord at https://discord.gg/5NJB6dD or just send pull requests / issues. For discussion use the forums at forums.ppsspp.org.