local-llm

There are 38 repositories under local-llm topic.

anything-llm
Mintplex-Labs / anything-llm
The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.
ai-agents custom-ai-agents deepseek kimi llama3 llm lmstudio local-llm localai mcp mcp-servers moonshot multimodal no-code ollama qwen3 rag vector-database web-scraping
Language:JavaScript 50805
langroid
langroid / langroid
Harness LLMs with Multi-Agent Programming
agents ai chatgpt function-calling gpt gpt-4 gpt4 information-retrieval language-model llama llm llm-agent llm-framework local-llm multi-agent-systems openai-api rag retrieval-augmented-generation
Language:Python 3752
LearningCircuit / local-deep-research
Local Deep Research achieves ~95% on SimpleQA benchmark (tested with GPT-4.1-mini). Supports local and cloud LLMs (Ollama, Google, Anthropic, ...). Searches 10+ sources - arXiv, PubMed, web, and your private documents. Everything Local & Encrypted.
academia arxiv brave deep-research local local-llm mistral pubmed research research-tool retrieval-augmented-generation searxng self-hosted local-deep-research home-automation homeserver ollama anthropic openai encryption
Language:Python 3585
openai-edge-tts
travisvn / openai-edge-tts
Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs
ai azure chatgpt claude edge-tts elevenlabs gpt llm llm-webui llms local-llm ollama ollama-webui open-webui openai self-hosted speech text-to-speech tts
Language:Python 1365
runebookai / tome
a magical LLM desktop client that makes it easy for *anyone* to use LLMs and MCP
llm llms mcp ollama mcp-client mcp-clients gemini local-llm localai no-code openai qwen3 llm-client
Language:Svelte 538
lxe / llavavision
A simple "Be My Eyes" web app with a llama.cpp/llava backend
ai artificial-intelligence computer-vision llama llamacpp llm local-llm machine-learning multimodal webapp
Language:JavaScript 492
withcatai / catai
Run AI ✨ assistant locally! with simple API for Node.js 🚀
chatgpt ai dalai openai chatbot chatui llama-cpp ai-assistant vicuna vicuna-installation-guide wizardlm catai llm ggmlv3 local-llm localai gguf node-llama-cpp nodejs
Language:TypeScript 479
hydropix / TranslateBookWithLLM
A python script designed to translate large amounts of text with an LLM and the Ollama API
epub gemini gemini-api llm local-llm localization-tool ollama openai-api srt-subtitles translation translation-tool
Language:Python 413
chatterbox-tts-api
travisvn / chatterbox-tts-api
Local, OpenAI-compatible text-to-speech (TTS) API using Chatterbox, enabling users to generate voice cloned speech anywhere the OpenAI API is used (e.g. Open WebUI, AnythingLLM, etc.)
ai chatgpt chatterbox cuda docker elevenlabs gpt local-llm ollama open-webui openai openai-api python self-hosted speech text-to-speech tts voice-clone voice-cloning
Language:Python 366
jonigl / mcp-client-for-ollama
A text-based user interface (TUI) client for interacting with MCP servers using Ollama. Features include multi-server, dynamic model switching, streaming responses, tool management, human-in-the-loop, thinking mode, full model parameters configuration, custom system prompt and saved preferences. Built for developers working with local LLMs.
ai command-line-tool generative-ai linux llm local-llm macos mcp mcp-client mcp-server model-context-protocol model-selection ollama open-source pypi-package sse stdio streamable-http tool-management windows
Language:Python 361
resume-ai
resume-llm / resume-ai
A local, privacy-first résumé builder using LLMs and Markdown to generate ATS-ready DOCX files with Pandoc — no cloud, no tracking.
ai-resume-builder local-llm resume-builder
Language:TypeScript 350
rockbite / localforge
Local coding agent with neat UI
ai ai-agents ai-framework javascript langchain local-llm prompt-engineering vibe-coding
Language:JavaScript 323
shreyaskarnik / DistiLlama
Chrome Extension to Summarize or Chat with Web Pages/Local Documents Using locally running LLMs. Keep all of your data and conversations private. 🔐
chrome-extension llama2 llms local-llm ollama summarization retrieval-augmented-generation langchain mistral-7b readability privacy-preserving-computing private zephyr
Language:TypeScript 300
deveix / react-native-apple-llm
React Native Apple LLM plugin using Foundation Models
apple-intelligence apple-llm apple-llm-integration local-llm react-native react-native-llm react-native-plugin zod react-native-local-llm react-native-apple-llm apple-foundation-models foundation-models react-native-apple nlp offline-ai react-native-ai structured-output text-generation react-native-apple-intelligence
Language:Swift 294
mrkrsl / web-search-mcp
A simple, locally hosted Web Search MCP server for use with Local LLMs
llm lmstudio local-llm mcp web-search
Language:TypeScript 288
rafska / Awesome-local-LLM
A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally
ai awesome awesome-list llm local local-ai local-llm resources self-hosted selfhosted
288
llm-axe
emirsahin1 / llm-axe
A simple, intuitive toolkit for quickly implementing LLM powered applications.
function-calling llama3 llm local-llm ollama pdf-llm
Language:Python 267
vscode-reborn-ai
vscode-reborn-ai / vscode-reborn-ai
Code with AI in VSCode, bring your own ai.
vscode-extension ai gpt-4o local-llm openrouter hacktoberfest gpt-o1
Language:TypeScript 260
AstraBert / everything-ai
Your fully proficient, AI-powered and local chatbot assistant🤖
ai ai-studio chatgpt cheshire-cat docker-image free-to-use generative-ai image-classification jan-ai langchain learning local-llm open-source qdrant stable-diffusion text-summarization
Language:Python 247
kamjin3086 / chatless
💻一款简洁实用轻量级的本地AI对话客户端，采用Tauri2.0和Next.js编写 A simple, practical, and lightweight local AI chat client, written in Tauri 2.0 & Next.js.
ai chatbot desktop-app knowledge-base llm local-llm nextjs offline-first ollama openai privacy-focused rag react rust tauri typescript
Language:TypeScript 232
datacrystals / AIStoryWriter
LLM story writer with a focus on high-quality long output based on a user provided prompt.
ai command-line-tool llm llms local-llama local-llm python story-generator storywriting
Language:Python 192
sfortis / openai_tts
Custom TTS component for Home Assistant. Utilizes the OpenAI speech engine or any compatible endpoint to deliver high-quality speech. Optionally offers chime and audio normalization features.
ai chime ha hacs home-assistant homeassistant llm local-llm openai self-hosted speech-synthesis text-to-speech tts
Language:Python 155
nath1295 / LLMFlex
A python package for developing AI applications with local LLMs.
local-llm prompt-engineering vector-database
Language:Python 151
xtekky / gpt4local
Openai-style, fast & lightweight local language model inference w/ documents
ai chatbot chatbots chatgpt chatgpt-api gpt gpt-4 gpt4free language-model llm llm-inference local local-llm openai openai-api python documents
Language:Python 131
BodhiSearch / BodhiApp
Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
gemma generative-ai llama llm local-llm localllm mistral open-source-llm private-llm
Language:TypeScript 121
daviddaytw / react-native-transformers
Run local LLM from Huggingface in React-Native or Expo using onnxruntime.
expo huggingface local-llm onnx onnxruntime react-native transformers
Language:TypeScript 121
Fus3n / TwoAI
A simple experiment on letting two local LLM have a conversation about anything!
ai ai-agent ai-conversations local-llm ollama python twoai
Language:Python 111
Picovoice / pico-cookbook
Recipes for on-device voice AI and local LLM
cookbook llm llm-inference local-llm on-device-ai recipes voice-ai voice-assistant
Language:Python 98
Likhithsai2580 / JARVIS
Project Jarvis is a versatile AI assistant that integrates various functionalities.
assistant g4f gui jarvis multifunctional ocr offline online open-source python tonystark voice wakeword agent agents local-llm multithreading voice-assistant jarvis-ai
Language:Python 97
enescingoz / colab-llm
This repository provides a ready-to-use Google Colab notebook that turns Colab into a temporary server for running local LLM models using Ollama. It exposes the model API via a secure Cloudflare tunnel, allowing remote access from tools like curl or ROO Code in VS Code — no server setup or cloud deployment required.
colab local-llm ollama
Language:Jupyter Notebook 90
Aestheticsuraj234 / vibecode-playground
Vibecode Editor is a fullstack, web-based IDE built with Next.js and Monaco Editor. It features real-time code execution using WebContainers, AI-powered code suggestions via locally running Ollama models, multi-stack templates, an integrated terminal, and a developer-focused UI for seamless coding in the browser.
browser-ide code-editor developer-tools fullstack javascript-editor local-llm monaco-editor nextauth nextjs ollama shadcn-ui tailwindcss typescript web-ide webcontainers xtermjs ai-autocomplete
Language:TypeScript 88
lennartpollvogt / ollama-instructor
Python library for the instruction and reliable validation of structured outputs (JSON) of Large Language Models (LLMs) with Ollama and Pydantic. -> Deterministic work with LLMs.
json-schema llm ollama pydantic local-llm validation instructor prompting json
Language:Python 76
davideuler / pdf-translator-for-human
A flexible free and unlimited PDF Translator for Human with Local-LLM or ChatGPT
llm local-ai local-llm pdf-reader pdf-translator translator side-by-side-translator
Language:Python 71
edgett / PalmHill.BlazorChat
PalmHill.BlazorChat is a chat application and API built with Blazor WebAssembly, SignalR, and WebAPI, featuring real-time LLM conversations, markdown support, customizable settings, and a responsive design. This project supports Llama2 models and was tested with Orca2.
blazor-webassembly chatgpt csharp gpu llama2 llm llm-inference local-llm markdown-support net8 orca2 realtime-chat signalr webapi
Language:C# 68
royshil / note-taker
A lo-fi AI-first note taker running locally on-device
ai llm local-llm note-taking notes-app notes-tool summarization transcription
Language:Python 67
simple-rag
ParthSareen / simple-rag
Too many docs? Quickly search over any PDF or Markdown documents
llama ollama python rag obsidian-md local-llm obsidian
Language:Python 57

local-llm

Mintplex-Labs / anything-llm

langroid / langroid

LearningCircuit / local-deep-research

travisvn / openai-edge-tts

runebookai / tome

lxe / llavavision

withcatai / catai

hydropix / TranslateBookWithLLM

travisvn / chatterbox-tts-api

jonigl / mcp-client-for-ollama

resume-llm / resume-ai

rockbite / localforge

shreyaskarnik / DistiLlama

deveix / react-native-apple-llm

mrkrsl / web-search-mcp

rafska / Awesome-local-LLM

emirsahin1 / llm-axe

vscode-reborn-ai / vscode-reborn-ai

AstraBert / everything-ai

kamjin3086 / chatless

datacrystals / AIStoryWriter

sfortis / openai_tts

nath1295 / LLMFlex

xtekky / gpt4local

BodhiSearch / BodhiApp

daviddaytw / react-native-transformers

Fus3n / TwoAI

Picovoice / pico-cookbook

Likhithsai2580 / JARVIS

enescingoz / colab-llm

Aestheticsuraj234 / vibecode-playground

lennartpollvogt / ollama-instructor

davideuler / pdf-translator-for-human

edgett / PalmHill.BlazorChat

royshil / note-taker

ParthSareen / simple-rag