cyyeh

connect

Fancy stream processing made operationally mundane

superagent

🥷 Run AI-agents with an API

mlc-llm

Universal LLM Deployment Engine with ML Compilation

DataDreamer

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

generative_agents

Generative Agents: Interactive Simulacra of Human Behavior

awesome-llm-powered-agent

Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...

AgentBench

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

self-rag

This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.

OpenDevin

🐚 OpenDevin: Code Less, Make More

gorilla

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

lilac

Curate better data for LLMs

doccano

Open source annotation tool for machine learning practitioners.

hatchet

A distributed, fault-tolerant task queue

fastembed

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

goingmeta

code and resources used in the Going Meta sessions

nebula

A distributed, fast open-source graph database featuring horizontal scalability and high availability

awesome-generative-ai

A curated list of modern Generative Artificial Intelligence projects and services

GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

text-to-sql-bedrock-workshop

This repository is intended for those looking to dive deep on advanced Text-to-SQL concepts.

awesome-generative-information-retrieval

awesome-opensource-ai-engineering

Explore a curated collection of exceptional open-source libraries for generative AI meticulously reviewed or slated for review by The AI Engineer. Contribute your own projects to be considered for evaluation and inclusion in this dynamic repository dedicated to advancing the AI engineering discipline.

hamilton

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

atopile

Design circuit boards with code! ✨ Get software-like design reuse 🚀, validation, version control and collaboration in hardware; starting with electronics ⚡️

the-art-of-debugging

The Art of Debugging

ml-engineering

Machine Learning Engineering Open Book

AutoRAG

RAG AutoML Tool - Find optimal RAG pipeline for your own data.

litellm

LLM Proxy to call 100+ LLM APIs using the OpenAI format - Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq

truss

The simplest way to serve AI/ML models in production