barbudour / lunary

The production toolkit for LLMs. Observability, prompt management and evaluations.

Home Page:https://lunary.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

πŸ“ˆ lunary

Open-source observability & prompt platform for LLMs

website - docs - self host

npm version PyPI - Version GitHub last commit (by committer) GitHub commit activity (branch)

Features

Lunary helps AI devs take their apps in production, with features such as:

  • πŸ’΅ Analytics (cost, token, latency, ..)
  • πŸ” Monitoring (logs, traces, user tracking, ..)
  • ⛩️ Prompt Templates (versioning, team collaboration, ..)
  • 🏷️ Creat fine-tuning datasets
  • πŸ–²οΈ Chat & feedback tracking
  • πŸ§ͺ Evaluations

It also designed to be:

  • πŸ€– Usable with any model, not just OpenAI
  • πŸ“¦ Easy to integrate (2 minutes)
  • πŸ§‘β€πŸ’» Simple to self-host

Demo

demo720.mp4

βš™οΈ Integration

Modules available for:

Lunary natively supports:

Additionally you can use it with any framework by wrapping the relevant methods.

πŸ“š Documentation

Full documentation is available on the website.

☁️ Hosted version

We offer a hosted version with a free plan of up to 1k requests / days.

With the hosted version:

  • πŸ‘· don't worry about devops or managing updates
  • πŸ™‹ get priority 1:1 support with our team
  • πŸ‡ͺπŸ‡Ί your data is stored safely in Europe

Running locally

Lunary is powered by Node.js.

To run it locally, you'll need access to a Postgres database to set as the DATABASE_URL in your .env file.

# Clone the repository
git clone https://github.com/lunary-ai/lunary

# Copy env variables
cp .env.example .env

# Install dependencies
npm install

## Run DB migrations
npm run migrate:db

# Run the development server
npm run dev

πŸ™‹ Support

Need help or have questions? Chat with us on the website or email us: hello [at] lunary.ai. We're here to support you every step of the way.

License

This project is licensed under the Apache 2.0 License.

About

The production toolkit for LLMs. Observability, prompt management and evaluations.

https://lunary.ai

License:Apache License 2.0


Languages

Language:TypeScript 97.8%Language:Python 1.4%Language:CSS 0.5%Language:JavaScript 0.3%Language:Shell 0.1%