taku-ito

persona-hub

Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"

mesop

Build delightful web apps quickly in Python

outlines

Structured Text Generation

instructor

structured outputs for llms

distilabel

⚗️ distilabel is a framework for synthetic data and AI feedback for AI engineers that require high-quality outputs, full data ownership, and overall efficiency.

artkit

Automated prompt-based testing and evaluation of Gen AI applications

LLM-eval-survey

The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".

LLMDataHub

A quick guide (especially) for trending instruction finetuning datasets

mindsdb

The platform for building AI from enterprise data

Adala

Adala: Autonomous DAta (Labeling) Agent framework

llm-app

Dynamic RAG for enterprise. Ready to run with Docker,⚡in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

langkit

🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀

llamafile

Distribute and run LLMs with a single file.

unsloth

Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

bark

🔊 Text-Prompted Generative Audio Model

langfuse

🪢 Open source LLM engineering platform: Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

ultrajson

Ultra fast JSON decoder and encoder written in C with Python bindings

mrab-regex

text-dedup

All-in-one text de-duplication

preprocess

Corpus preprocessing

AlignScore

ACL2023 - AlignScore, a metric for factual consistency evaluation.

optimum

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

J-UniMorph

Dataset of UniMorph in Japanese

DataDreamer

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

Appraise

Appraise code used as part of WMT21 human evaluation campaign

TransformerLens

A library for mechanistic interpretability of GPT-style language models

whisperX

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

uptrain

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

reflex

🕸️ Web apps in pure Python 🐍

reactpy

It's React, but in Python