azell

rensa

High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datasets

secator

secator - the pentester's swiss knife

pyjanitor

Clean APIs for data cleaning. Python implementation of R package Janitor

ai-bot-blocker

Ichido AI and LLM Bot Blocker

marvin-recipes

applications of https://github.com/PrefectHQ/marvin

AutoAWQ

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

Top2Vec

Top2Vec learns jointly embedded topic, document and word vectors.

BERTopic

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

GraphRAG-SDK

Facilitate the creation of graph-based Retrieval-Augmented Generation (RAG), seamless integration with OpenAI to enable advanced data querying and knowledge graph construction.

cookie

Cookies, but with structs, for happiness.

omniparse

Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks

oxc

⚓ A collection of JavaScript tools written in Rust.

mako

An extremely fast, production-grade web bundler based on Rust.

graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system

whodb

A lightweight next-gen database explorer - Postgres, MySQL, SQLite, MongoDB, Redis, MariaDB & Elastic Search

cdn-cache-control

Easy cache header handling

python-task-queue

Asynchronous serverless task queue with timed leasing of tasks. Threaded implementations for SQS and local filesystem.

micro-memoize

A tiny, crazy fast memoization library for the 95% use-case

gs-quant

Python toolkit for quantitative finance

kubeflow

Machine Learning Toolkit for Kubernetes

FFmpeg-For-Beginners-Ebook

Open source release of FFmpeg For Beginners - Edit Audio & Video Like a Pro for Youtube and Social Media

semantic-router

Superfast AI decision making and intelligent processing of multi-modal data.

nougat

Implementation of Nougat Neural Optical Understanding for Academic Documents

SimplerLLM

Simplify interactions with Large Language Models

semantic-split

A Python library to chunk/group your texts based on semantic similarity.

swirl-search

SWIRL AI Connect: AI infrastructure software that powers your Search & Retrieval Augmented Generation (RAG) applications. Simplify and enhance your AI pipelines with seamless integration of large language models (LLMs) and data sources.

AutoRAG

RAG AutoML Tool - Find optimal RAG pipeline for your own data.

FlashRank

Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & Collaborations.

llama-agents

jorb

Job Processing Library