Beckham007

skypilot

SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

dataherald

Interact with your SQL database, Natural Language to SQL using LLMs

agentscope

Start building LLM-empowered multi-agent applications in an easier way.

inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

candle

Minimalist ML framework for Rust

gpu-manager

grok-1

Grok open release

FastGPT

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

orama

🌌 Fast, dependency-free, full-text and vector search engine with typo tolerance, filters, facets, stemming, and more. Works with any JavaScript runtime, browser, server, service!

LWM

search_with_lepton

Building a quick conversation-based search demo with Lepton AI.

danswer

Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.

awesome-pretrained-chinese-nlp-models

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

InternLM

Official release of InternLM2 7B and 20B base and chat models. 200K context support

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

FlagData

KwaiAgents

A generalized information-seeking agent system with Large Language Models (LLMs).

ChatGPT-Next-Web

A cross-platform ChatGPT/Gemini UI (Web / PWA / Linux / Win / MacOS). 一键拥有你自己的跨平台 ChatGPT/Gemini 应用。

mlc-llm

Universal LLM Deployment Engine with ML Compilation

lobe-chat

🤯 Lobe Chat - an open-source, modern-design LLMs/AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Bedrock / Azure / Mistral / Perplexity ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT chat application.

MetaGPT

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

autogen

A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap

XAgent

An Autonomous LLM Agent for Complex Task Solving

awesome-ai-agents

A list of AI autonomous agents

CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

RAG-Survey

llama.cpp

LLM inference in C/C++

anything-llm

The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.