openai-compatible

There are 0 repository under openai-compatible topic.

• Michael-A-Kuykendall / shimmy

  ⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.

  api-servercommand-line-tooldeveloper-toolsggufhuggingfacehuggingface-modelshuggingface-transformersinference-serverllamallamacppllm-inferencelocal-ailoramachine-learningollama-apiopenai-compatiblerustrust-cratetransformers
  Language:Rust 3363

• cubist38 / mlx-openai-server

  A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.

  mlxmlx-vlmfastapimlx-lmqueueapple-siliconvision-apimlx-openai-serveropenai-compatiblespeech-recognitionfluximage-generationstructured-outputswhisper
  Language:Python 141

• hmjz100 / Z.ai2api

  将 Z.ai Chat 代理为 OpenAI/Anthropic Compatible 格式，支持多模型列表映射、免令牌、智能处理思考链、图片上传等功能；Z.ai ZtoApi z2api ZaitoApi zai X-Signature 签名 GLM 4.5 v 4.6

  ai2apichat2apizaizhipuzhipuaiopenai-compatiblellmopen-webuiopenaizai2apichatglmclaudeclaude-compatibleglmglm2apimodel-context-protocoltool-callinganthropic-claudeopenai-chatgptztoapi
  Language:Python 110

• amirkabiri / duckai

  duck.ai openai compatible api server

  duckaillmopenaiopenai-compatibleopenai-compatible-apitool-callingtool-calls
  Language:TypeScript 42

• CodeBoy2006 / falProxy

  A high-performance, self-hosted Deno proxy that makes Fal.ai's powerful models (Flux, SDXL, etc.) compatible with the standard OpenAI image generation API. Use any OpenAI client seamlessly.

  api-gatewaydenofal-aiimage-generationopenaiopenai-compatibleproxyproxy-serverself-hostedstable-diffusion
  Language:TypeScript 32

• iFwu / agent-tars-glm-4.5-adapter

  让 GLM-4.5 完美适配 Agent TARS 系统的高性能适配器 - 解决 toolcall 兼容性，提供智能 fallback，极低成本享受顶级 AI Agent 体验

  agent-tarsai-agentcost-effectivefallback-mechanismglm-4-5kimi-k2openai-compatibleqwen3-codertoolcall-adaptertypescript
  Language:TypeScript 20

• dwain-barnes / kyutai-tts-openai-api

  A Docker-based OpenAI-compatible Text-to-Speech API server powered by Kyutai's TTS models with GPU acceleration support.

  kyutaiopenai-apitext-to-speechttsdockerfastapiopenai-compatiblespeech-aitts-enginesvoice-generation
  Language:Python 13

• Alorse / copilot-to-api

  Complete guide to convert GitHub Copilot into an OpenAI-compatible API

  api-proxyapi-wrappercopilot-apigithub-copilotguideopenai-apiopenai-compatibleproxy-servertutorial
  Language:JavaScript 12

• nakasyou / ai-to-openai-hono

  An adapter to add OpenAI compatibility to your Hono app using the Vercel AI SDK

  ai-sdkhonollmopenaiopenai-compatibleopenai-compatible-apitypescriptvercel-ai-sdk
  Language:TypeScript 11

• dogarrowtype / Spark-TTS-cli-api

  Spark-TTS Text-to-Speech with an OpenAI-compatible API, supporting seamless, unlimited-length generations. Includes a CLI interface.

  cliopen-webuiopenai-apiopenai-compatibleopenai-compatible-apisillytaverntext-to-speechttstts-api
  Language:Python 9

• NGLSG / UniAPI

  The Universal LLM Gateway - Integrate ANY AI Model with One Consistent API

  aiai-toolsapi-clientapi-integrationapi-wrapperchatbotcppcross-platformcudagpu-acceleratedhigh-performancehttp-serverinference-serverlanguage-modelllmllm-integrationopenai-compatiblerest-apiuniversal-api
  Language:C++ 8

• kamilio / poe-api-bridge

  Poe API - OpenAI Compatible Wrapper

  chat-completionsopenai-compatibleopenai-compatible-apipoepoeaipoecom
  Language:Python 4

• statikfintechllc / GodCore

  All-in-one local AI stack for Mistral-13B and Llama.cpp, with one-step CUDA wheel install, OpenAI-compatible API, and modern web dashboard. Switch between local and cloud chat, run on your own GPU, and deploy instantly—no API keys or paywalls. Designed for easy install, custom builds, and fast remote access. Enjoy!

  aichatbotchatgptcudadashboardfastapillama-cppllmlocal-aimistralopenai-compatiblereactselfhostedwebui
  Language:Python 4

• viktorfaubl / QuietPrompt

  Local-first Copilot-style assistant powered by screen, mic, and clipboard input — fully offline, works with any LLM or OCR engine. Press a key, get results. No cloud, no lock-in.

  ai-assistantdeveloper-toolsocroffline-llmproductivity-toolscopilot-alternativeai-productivityllm-toolslocal-llmoffline-aiopenai-compatible
  Language:C# 4
• BLOCKCHAIN-AGI-AIR

  basedgod55hjl / BLOCKCHAIN-AGI-AIR

  🤖 Serverless AI on Hedera! Smart contracts run LLMs ⚙️ Distilled GGUF on IPFS. Pay crypto 🪙 → get replies 💬. 99.9% cheaper 💸 than big-tech APIs. Decentralized ⛓️ no censorship. “Gov can’t stop it. Nobody can.” 🧠 – Sir Charles Spikes , Cincinnati,Ohio| TELEGRAM: @SirGODSATANAGI✉️ SirCharlesspikes5@gmail.com #AGI #NoPC

  blockchaincryptocurrencydecentralized-aillama-cppsmart-contractsweb3artificial-intelligencegguf-modelshedera-hashgraphipfs-storageopenai-compatiblerevolutionserverless-aibc-offload-serverblockchain-agigovernment-resistantsir-charles-spikestoken-powered-aiunstoppable-agizero-servers
  Language:Java 3

• devdezzies / minigen

  A light-weight framework for building AI agents with Native OpenAI API compatibility

  agent-frameworkfunction-callinglightweightopenai-compatible
  Language:Python 2

• eagurin / synapse

  🧠 Synapse - Supercharge your AI coding assistants with memory, context, MCP tools, and intelligent routing. Works with Cline, Roo, Cursor, and any OpenAI-compatible tool. Just change the API endpoint and get superpowers! ✨

  clinecode-assistantcontinuecursorfastapifastmcplangchainlitellmllmmem0memory-systemsopenai-apiopenai-compatibler2rragvscode
  Language:Python 2

• mlibre / Unified-AI-Router

  A unified interface for multiple LLM providers with automatic fallback, ensuring your AI applications remain resilient. This project features an OpenAI-compatible server for seamless integration, tool support for enhanced functionality. It supports a wide range of major providers

  aichatbotfreellmload-balancertelegramvercelfree-aifallbackopenai-compatibleopenai-compatible-api
  Language:JavaScript 2

• claymore666 / MCPConnectionHub

  MCP Connection Hub - A unified Model Context Protocol Gateway

  ai-gatewayapiapi-gatewayasyncclidockerfastapifunction-callinglangchainllm-gatewayllm-toolsmicroservicesmodel-context-protocolopenai-apiopenai-compatibleplugin-systempythonredissqlalchemytool-registry
  Language:Python 1

• Ddemon26 / Lmss

  LmsSharp

  aiapichatclientllmlmstudiolocalopenai-compatible
  Language:C# 1

• Goldlionren / ComfyUI-OpenAI-Ask

  ComfyUI node: OpenAI-compatible Vision/QA with auto Prompt/Negative split

  aigccomfyuicomfyui-nodescustom-nodesopenai-compatibleragstable-diffusionvision-language
  Language:Python 1

• Inferra / Inferra-JS-SDK

  Official JavaScript/TypeScript SDK for Inferra API access

  aiapi-clientasyncbatch-processingjavascriptlanguage-modelsllamallmmachine-learningmistralnodejssdktypescriptinferraopenai-compatible
  Language:TypeScript 1

• Inferra / Inferra-Python-SDK

  Official Python SDK for Inferra API access

  llmpythonaiapi-clientasyncbatch-processinginferralanguage-modelsllamamachine-learningmistralopenai-compatiblesdk
  Language:Python 1

• naravid19 / typhoon-ocr

  Windows-focused fork of Typhoon OCR. Gradio demo for PDF/image OCR to Markdown/HTML with layout & table extraction. Uses OpenAI-compatible API or vLLM via WSL2.

  gradiomarkdownocropenai-compatiblepdf-ocrpopplerpythonthai-languagetyphoon-ocrvllmwindowswsl2
  Language:Python 1

• skyline-GTRr32 / claude-better-responses-mcp

  Improve Claude's coding responses with this MCP server

  ai-agentai-coding-toolsautonomous-agentsclaudedeveloper-toolsllmmcpmulti-agent-systemsopenai-compatibleprompt-engineeringsoftware-engineeringtool-usearchitecture-advisormcp-server
  Language:Python 1

• AlexPraxedes12 / LearnSynth

  Turn text/audio/video into study packs (summaries, concept maps, quizzes). Flutter + FastAPI. Uses GPT-OSS-20B (Replicate) by default, with optional fallbacks (OpenAI/Anthropic) and OSS modes (Ollama/vLLM).

  concept-mapedtechfastapifluttergpt-oss-20bllmocropen-source-llmopenaiopenai-compatiblequiz-generationreplicatetesseractwhisper
  Language:Dart

• BhomeshRazdan / QuietPrompt

  QuietPrompt is a local-first AI tool for coding. Capture screen text, voice, or typed prompts and run them offline with your LLM; no cloud 🐙

  ai-assistantai-productivitycopilot-alternativedeveloper-toolsllm-toolslocal-llmocroffline-aioffline-llmopenai-compatibleproductivity-tools
  Language:C#

• dwain-barnes / vui-fastapi-server

  A OpenAI-compatible Text-to-Speech API server powered by VUI - a small conversational speech model

  fastapiopenai-compatibletext-to-speechttsvui
  Language:Python

• github6666666666 / kyutai-tts-openai-api

  🎤 Power a fast, OpenAI-compatible Text-to-Speech API with GPU acceleration, supporting multiple audio formats and voice control in a complete Docker solution.

  dockerfastapikyutaiopenai-apiopenai-compatiblespeech-aitext-to-speechttstts-enginesvoice-generation
  Language:Python

• Marder66699 / BLOCKCHAIN-AGI-AIR

  🤖 Harness AI reasoning on blockchain with serverless architecture, utilizing HBAR tokens for on-demand, scalable intelligence without central servers.

  bc-offload-serverblockchainblockchain-agicryptocurrencydecentralized-aigguf-modelsgovernment-resistanthedera-hashgraphipfs-storagellama-cppopenai-compatiblerevolutionserverless-aisir-charles-spikessmart-contractstoken-powered-aiunstoppable-agiweb3
  Language:Java

• muhammadwaheedairi / eduhaiku-agent

  A CLI AI Agent that replies to educational questions in Haiku format using Gemini API.

  ai-agentcli-tooleducational-chatbotgemini-apillm-agentsopenai-compatible
  Language:Python

• TechWithTy / pollinations

  Pollinations.AI integrations for Next.js/TypeScript: authentication (Referrer & Bearer), OpenAI-compatible text proxy, real-time SSE feeds for image & text, and MCP helpers—with production-ready docs,

  aiauthenticationbearerdocsexamplesgenerative-aiimage-apimcpmodel-context-protocolnextjsopenai-compatiblepollinationsrealtimereferrersseteststext-apitext-to-imagettstypescript
  Language:TypeScript

• yanmxa / coder

  Reverse engineering Claude Code for customization and multi-model integration

  ai-toolsclaude-codecustomizationdevelopment-toolseducationalopenai-compatibleprompt-engineeringreverse-engineering