zish-rob-crur

swift

Fast voice assistant powered by Groq, Cartesia, and Vercel.

veaury

Use React in Vue3 and Vue3 in React, And as perfect as possible!

RouteLLM

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality.

GPU-Benchmarks-on-LLM-Inference

Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?

pipecat

Open Source framework for voice and multimodal conversational AI

gptpdf

Using GPT to parse PDF

omniparse

Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks

omniparser

omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.

mlx_parallm

Fast parallel LLM inference for MLX

bm25s

Fast lexical search library implementing BM25 in Python using Scipy (on average 2x faster than Elasticsearch in single-threaded setting)

lsp-ai

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

text-generation-inference

Large Language Model Text Generation Inference

granian

A Rust HTTP server for Python applications

litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

audio-decode

Minimal audio decoders layer

paddler

Stateful load balancer custom-tailored for llama.cpp

OFGB

GUI Tool To Removes Ads From Various Places Around Windows 11

llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

llama3-from-scratch

llama3 implementation one matrix multiplication at a time

FunClip

Open-source, accurate and easy-to-use video speech recognition & clipping tool, LLM based AI clipping intergrated.

marker-api

Easily deployable 🚀 API to convert PDF to markdown quickly with high accuracy.

glance

A self-hosted dashboard that puts all your feeds in one place

mini.nvim

Library of 40+ independent Lua modules improving overall Neovim (version 0.8 and higher) experience with minimal effort

unsloth

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

jwt

Community maintained clone of https://github.com/dgrijalva/jwt-go

fastapi-cli

Run and manage FastAPI apps from the command line with FastAPI CLI. 🚀

skyvern

Automate browser-based workflows with LLMs and Computer Vision

full-stack-template

awesome-cloudflare

⛅️ 精选的 Cloudflare 工具、开源项目、指南、博客和其他资源列表。/ ⛅️ A curated list of Cloudflare tools, open source projects, guides, blogs and other resources.