AdithyanI

sam2-studio

ell

A language model programming library.

viral-clips-crew

Your CrewAI Powered Video Editing Assistant

llm.c

LLM training in simple, raw C/CUDA

WhisperKit

On-device Speech Recognition for Apple Silicon

xT

whisperX

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

coolify

An open-source & self-hostable Heroku / Netlify / Vercel alternative.

minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

stable-audio-tools

Generative models for conditional audio generation

filler-word-removal

cortex.cpp

Run and customize Local LLMs.

ml-mgie

translation-starter

clipsai

Clips AI is an open-source Python library that automatically converts long videos into clips.

google-indexing-script

Script to get your site indexed on Google in less than 48 hours

LLM-automator

Create keyboard shortcuts for an LLM using OpenAI GPT, Ollama, HuggingFace with Automator on macOS.

plock

From anywhere you can type, query and stream the output of an LLM or any other script

lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

cv

Print-friendly, minimalist CV page

next-ai-news

mlx-benchmark

Benchmark of Apple MLX operations on all Apple Silicon chips (GPU, CPU) + MPS and CUDA.

dspy

DSPy: The framework for programming—not prompting—foundation models

RAGatouille

Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

lm-inference-engines

Comparison of Language Model Inference Engines

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

mlx-examples

Examples in the MLX framework

outlines

Structured Text Generation

candle

Minimalist ML framework for Rust