van51

marker

Convert PDF to markdown quickly with high accuracy

presidio

Context aware, pluggable and customizable data protection and de-identification SDK for text and images

litellm

LLM Proxy to call 100+ LLM APIs using the OpenAI format - Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq

dspy

DSPy: The framework for programming—not prompting—foundation models

bionic-gpt

BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality

dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

phoenix

AI Observability & Evaluation

extruct

Extract embedded metadata from HTML markup

aws-shell

An integrated shell for working with the AWS CLI.

smart_open

Utils for streaming large files (S3, HDFS, gzip, bz2...)

awless

A Mighty CLI for AWS

spacy-html-tokenizer

selectolax

Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).

llm

Access large language models from the command-line

txtai

💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

easyllm

llama2.c

Inference Llama 2 in one file of pure C

g3

All-in-one CLI to commit your work to Github

simpleaichat

Python package for easily interfacing with chat apps, with robust features and minimal code complexity.

Promptify

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Prompt-Engineering-Guide

🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

validators

Python Data Validation for Humans™.

Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.

guided-diffusion-keras

Text to Image Diffusion Models in Keras

memray

Memray is a memory profiler for Python

pycoingecko

Python wrapper for the CoinGecko API

awesome-production-machine-learning

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning