S1ahs3r's starred repositories

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Language:PythonLicense:Apache-2.0Stargazers:29536Issues:244Issues:5103

llamafile

Distribute and run LLMs with a single file.

Language:C++License:NOASSERTIONStargazers:20167Issues:175Issues:427

fish-speech

Brand new TTS solution

Language:PythonLicense:NOASSERTIONStargazers:13763Issues:96Issues:399

litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

Language:PythonLicense:NOASSERTIONStargazers:13470Issues:72Issues:3478

server

screen sharing for developers https://screego.net/

Language:GoLicense:GPL-3.0Stargazers:7759Issues:101Issues:135

nezha

:trollface: Self-hosted, lightweight server and website monitoring and O&M tool

Language:GoLicense:Apache-2.0Stargazers:7200Issues:43Issues:0

langfuse

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

Language:TypeScriptLicense:NOASSERTIONStargazers:6231Issues:24Issues:666

gocron

Easy and fluent Go cron scheduling. This is a fork from https://github.com/jasonlvhit/gocron

camel

🐫 CAMEL: Finding the Scaling Law of Agents. A multi-agent framework. https://www.camel-ai.org

Language:PythonLicense:Apache-2.0Stargazers:5545Issues:64Issues:482

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Language:PythonLicense:Apache-2.0Stargazers:4560Issues:37Issues:1432

wiseflow

Wiseflow is an agile information mining tool that extracts concise messages from various sources such as websites, WeChat official accounts, social platforms, etc. It automatically categorizes and uploads them to the database.

Language:PythonLicense:NOASSERTIONStargazers:4426Issues:47Issues:105

quicktemplate

Fast, powerful, yet easy to use template engine for Go. Optimized for speed, zero memory allocations in hot paths. Up to 20x faster than html/template

Language:GoLicense:MITStargazers:3114Issues:66Issues:71

glasskube

🧊 The next generation Package Manager for Kubernetes 📦 Featuring a GUI and a CLI. Glasskube packages are dependency aware, GitOps ready and can get automatic updates via a central public package repository.

Language:GoLicense:Apache-2.0Stargazers:2997Issues:13Issues:359

nextflow

A DSL for data-driven computational pipelines

Language:GroovyLicense:Apache-2.0Stargazers:2746Issues:88Issues:3281

BLEUnlock

Lock/unlock your Mac with your iPhone, Apple Watch, or any other Bluetooth LE devices

Streamer-Sales

Streamer-Sales 销冠 —— 卖货主播 LLM 大模型🛒🎁,一个能够根据给定的商品特点从激发用户购买意愿角度出发进行商品解说的卖货主播大模型。🚀⭐内含详细的数据生成流程❗ 📦另外还集成了 LMDeploy 加速推理🚀、RAG检索增强生成 📚、TTS文字转语音🔊、数字人生成 🦸、 Agent 使用网络查询实时信息🌐、ASR 语音转文字🎙️、Vue 生态搭建前端🍍、FastAPI 搭建后端🗝️、Docker-compose 打包部署🐋

Language:PythonLicense:AGPL-3.0Stargazers:2524Issues:39Issues:28

ai-artifacts

Hackable open-source version of Anthropic's Claude Artifacts by E2B

Language:TypeScriptLicense:Apache-2.0Stargazers:2392Issues:19Issues:43

surgio

Generating rules for Surge, Clash, Quantumult like a PRO

Language:TypeScriptLicense:MITStargazers:1612Issues:23Issues:147

simple-one-api

OpenAI 接口接入适配,支持千帆大模型平台、讯飞星火大模型、腾讯混元以及MiniMax、Deep-Seek,等兼容OpenAI接口,仅单可执行文件,配置超级简单,一键部署,开箱即用. Seamlessly integrate with OpenAI and compatible APIs using a single executable for quick setup and deployment.

Language:GoLicense:MITStargazers:1339Issues:14Issues:71

lunary

The production toolkit for LLMs. Observability, prompt management and evaluations.

Language:TypeScriptLicense:Apache-2.0Stargazers:1068Issues:7Issues:136

override

啥也不是

Language:GoLicense:MITStargazers:946Issues:6Issues:29

genkit

An open source framework for building AI-powered apps with familiar code-centric patterns. Genkit makes it easy to develop, integrate, and test AI features with observability and evaluations. Genkit works with various models and platforms.

Language:TypeScriptLicense:Apache-2.0Stargazers:727Issues:25Issues:320

goref

Go heap object reference analysis tool

Language:GoLicense:Apache-2.0Stargazers:568Issues:10Issues:14

jtokkit

JTokkit is a Java tokenizer library designed for use with OpenAI models.

Language:JavaLicense:MITStargazers:563Issues:7Issues:32

gollama

Go manage your Ollama models

Language:GoLicense:MITStargazers:456Issues:9Issues:40

dify-sandbox

A lightweight, fast, and secure code execution environment that supports multiple programming languages

Language:GoLicense:Apache-2.0Stargazers:416Issues:4Issues:53

easyvideotrans

Easyvideotrans后端。 https://easyvideotrans.com/

Language:PythonLicense:GPL-3.0Stargazers:382Issues:8Issues:12

AI-Vtuber

一个高自由度的端到端的可定制AI-VTuber。支持对接哔哩哔哩直播间,以智谱API作为语言基座模型,拥有意图识别、长短期记忆(直接记忆和联想记忆),支持搭建认知库、歌曲作品库,接入了当前热门的一些语音转换、语音合成、图像生成、数字人驱动项目,并提供了一个便于操作的客户端。

Language:PythonLicense:MITStargazers:313Issues:7Issues:10

async

Synchronization and asynchronous computation package for Go

Language:GoLicense:MITStargazers:221Issues:5Issues:1

cookie

Cookies, but with structs, for happiness.

Language:GoLicense:MITStargazers:110Issues:4Issues:1