arunreddy

openllmetry

Open-source observability for your LLM application, based on OpenTelemetry

magicui

UI Library for Design Engineers. Animated components and effects you can copy and paste into your apps. Free. Open Source.

The_Prompt_Report

gitkit

Git toolkit for Go: Smart HTTP server, SSH server, hook receiver

soft-serve

The mighty, self-hostable Git server for the command line🍦

piko

An open-source alternative to Ngrok, designed to serve production traffic and be simple to host (particularly on Kubernetes)

meteroid

Open-source Pricing and Billing Infrastructure 🚀 Subscription management, Invoicing, Pricing, Usage-based billing, Cost limiting, Grandfathering, Experiments, Revenue analytics & Actionable insights

AgentKit

An intuitive LLM prompting framework for multifunctional agents, by explicitly constructing a complex "thought process" from simple natural language prompts.

fiber

⚡️ Express inspired web framework written in Go

gocache

☔️ A complete Go cache library that brings you multiple ways of managing your caches

lm-format-enforcer

Enforce the output format (JSON Schema, Regex etc) of a language model

yamlscript

Programming in YAML

llm_distillation_playbook

Best practices for distilling large language models.

JARVIS

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

AgentBoard

An Analytical Evaluation Board of Multi-turn LLM Agents

OLMo

Modeling, training, eval, and inference code for OLMo

AIcons

An icon set for generative AI applications

firecamp

Developer-first OpenSource API DevTool, Postman/Insomnia alternative.

LLMCompiler

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

superduper

🔮 SuperDuper: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.

lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

ipyexperiments

Automatic GPU+CPU memory profiling, re-use and memory leaks detection using jupyter/ipython experiment containers

langroid

Harness LLMs with Multi-Agent Programming

ubicloud

Open, free, and portable cloud. Elastic compute, block storage (non replicated), virtual networking, managed Postgres, and IAM services in public beta.

S-LoRA

S-LoRA: Serving Thousands of Concurrent LoRA Adapters

alignment-handbook

Robust recipes to align language models with human and AI preferences

OpenAgents

[COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild

BotifyMe

carton

Run any ML model from any programming language.

rustlings

:crab: Small exercises to get you used to reading and writing Rust code!