bilelomrani1

openllmetry

Open-source observability for your LLM application, based on OpenTelemetry

lilac

Curate better data for LLMs

metabase

The simplest, fastest way to get business intelligence and analytics to everyone in your company :yum:

litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate, Groq (100+ LLMs)

FuzzTypes

Pydantic extension for annotating autocorrecting fields.

hatchet

A distributed, fault-tolerant task queue

oxidized-transformers

Modular Rust transformer/LLM library using Candle

optimum-quanto

A pytorch quantization backend for optimum

rerankers

scaphandre

⚡ Energy consumption metrology agent. Let "scaph" dive and bring back the metrics that will help you make your systems and applications more sustainable !

open-webui

User-friendly WebUI for LLMs (Formerly Ollama WebUI)

DataDreamer

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

aphrodite-engine

PygmalionAI's large-scale inference engine

instant-distance

Fast approximate nearest neighbor searching in Rust, based on HNSW index

luminal

Deep learning at the speed of light.

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

opendal

Apache OpenDAL: access data freely.

datafusion

Apache DataFusion SQL Query Engine

uv

An extremely fast Python package installer and resolver, written in Rust.

lifelines

Survival analysis in Python

mitmproxy

An interactive TLS-capable intercepting HTTP proxy for penetration testers and software developers.

surya

OCR, layout analysis, reading order, line detection in 90+ languages

promptfoo

Test your prompts, agents, and RAGs. Redteaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

samply

Command-line sampling profiler for macOS and Linux

layout-parser

A Unified Toolkit for Deep Learning Based Document Image Analysis

roma

RoMa: A lightweight library to deal with 3D rotations in PyTorch.

rust

Empowering everyone to build reliable and efficient software.

nlm-ingestor

This repo provides the server side code for llmsherpa API to connect. It includes parsers for various file formats.

rbloom

A fast, simple and lightweight Bloom filter library for Python, implemented in Rust.

sglang

SGLang is yet another fast serving framework for large language models and vision language models.