xoicy

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

DocsGPT

GPT-powered chat for documentation, chat with your documents

ChatTTS

A generative speech model for daily dialogue.

gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

storm

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

phoenix

AI Observability & Evaluation

llamafile

Distribute and run LLMs with a single file.

py-webrtcvad

Python interface to the WebRTC Voice Activity Detector

FunASR

A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.

openvino

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

fabric

fabric is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.

agentops

Python SDK for agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen

TextWorld

​TextWorld is a sandbox learning environment for the training and evaluation of reinforcement learning (RL) agents on text-based games.

AriGraph

langchain

🦜🔗 Build context-aware reasoning applications

RTranslator

Open source real-time translation app for Android that runs locally

promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

LLMLingua

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

anything-llm

The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.

agenta

The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.

Prompt-Engineering-Guide

🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

code2prompt

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

textgrad

TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.

promptsource

Toolkit for creating, sharing and using natural language prompts.

prompt-engine

A library for helping developers craft prompts for Large Language Models

crewAI-tools

R2R

The Elasticsearch for RAG - R2R lets you build, scale, and manage user-facing Retrieval-Augmented Generation applications in production.

pipecat

Open Source framework for voice and multimodal conversational AI

PyLivestream

Pure Python FFmpeg-based live video / audio streaming to YouTube, Facebook, Periscope, Twitch, and more