InftyAI

llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

Awesome-LLMOps

🎉 An awesome & curated list of best LLMOps tools.

llmlite

🌵 A library helps to communicate with all kinds of LLMs consistently.

Manta

💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯

llmboard

ChatUI for LLMs on llmaz.

scheduler-plugins

Scheduler plugins designed for smart scheduling with llmaz.

omnistore

🎯 An unified python client to communicate with various kinds of object-store providers.

PR-Copilot

Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑‍💻🐛

website

Website and Blogs.

.github

community

The InftyAI community.

llmaz-helm

Helm installation for llmaz.

template-repo

A template repo.