local-llm

There are 7 repositories under local-llm topic.

anything-llm
Mintplex-Labs / anything-llm
The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.
ai-agents chromadb crewai crewaiui desktop-app llama3 llamacpp llm llm-application llm-webui lmstudio local-llm localai ollama rag vector-database webui
Language:JavaScript 15696
langroid
langroid / langroid
Harness LLMs with Multi-Agent Programming
agents ai chatgpt function-calling gpt gpt-4 gpt4 information-retrieval language-model llama llm llm-agent llm-framework local-llm multi-agent-systems openai-api question-answering rag retrieval-augmented-generation
Language:Python 1802
lxe / llavavision
A simple "Be My Eyes" web app with a llama.cpp/llava backend
ai artificial-intelligence computer-vision llama llamacpp llm local-llm machine-learning multimodal webapp
Language:JavaScript 466
withcatai / catai
Run AI ✨ assistant locally! with simple API for Node.js 🚀
chatgpt ai dalai openai chatbot chatui llama-cpp ai-assistant vicuna vicuna-installation-guide wizardlm catai llm ggmlv3 local-llm localai gguf node-llama-cpp nodejs
Language:TypeScript 417
shreyaskarnik / DistiLlama
Chrome Extension to Summarize or Chat with Web Pages/Local Documents Using locally running LLMs. Keep all of your data and conversations private. 🔐
chrome-extension llama2 llms local-llm ollama summarization retrieval-augmented-generation langchain mistral-7b readability privacy-preserving-computing private zephyr
Language:TypeScript 216
nath1295 / LLMFlex
A python package for developing AI applications with local LLMs.
local-llm prompt-engineering vector-database
Language:Python 94
AstraBert / everything-ai
Your fully proficient, AI-powered and local chatbot assistant🤖
ai ai-studio chatgpt cheshire-cat docker-image free-to-use generative-ai image-classification jan-ai langchain learning local-llm open-source qdrant stable-diffusion text-summarization
Language:Python 83
Fus3n / TwoAI
A simple experiment on letting two local LLM have a conversation about anything!
ai ai-agent ai-conversations local-llm ollama python
Language:Python 76
xtekky / gpt4local
Openai-style, fast & lightweight local language model inference w/ documents
ai chatbot chatbots chatgpt chatgpt-api gpt gpt-4 gpt4free language-model llm llm-inference local local-llm openai openai-api python documents
Language:Python 65
gsuuon / ad-llama
Structured inference with Llama 2 in your browser
llm mlc javascript local-llm npm
Language:TypeScript 47
Picovoice / pico-cookbook
Recipes for on-device voice AI and local LLM
cookbook llm llm-inference local-llm on-device-ai recipes voice-ai voice-assistant
Language:Java 29
llm-axe
emirsahin1 / llm-axe
A simple, intuitive toolkit for quickly implementing LLM powered applications.
function-calling llama3 llm local-llm ollama pdf-llm
Language:Python 28
ShelbyJenkins / llm_client
Rust library for integrating local LLMs (with llama.cpp) and external LLM APIs.
ai ggml llama-cpp llamacpp llm local-llm openai rust
Language:Rust 27
Fus3n / infinite-sides
Infinite Craft but in Pyside6 and Python with local LLM (llama2 & others) using Ollama
desktop-app game gui infinite-craft infinite-sides local-llm ollama pyside6 python
Language:Python 24
edgett / PalmHill.BlazorChat
PalmHill.BlazorChat is a chat application and API built with Blazor WebAssembly, SignalR, and WebAPI, featuring real-time LLM conversations, markdown support, customizable settings, and a responsive design. This project supports Llama2 models and was tested with Orca2.
blazor-webassembly chatgpt csharp gpu llama2 llm llm-inference local-llm markdown-support net8 orca2 realtime-chat signalr webapi
Language:C# 23
J4NN0 / llm-rag
LLMs prompt augmentation with RAG by integrating external custom data from a variety of sources, allowing chat with such documents
chat-application chatbot chatgpt custom-data llm llm-apps llm-framework llms llama llama-index rag retrieval-augmented-generation chatapp rag-embeddings llama2 llamacpp local-llama local-llm mixtral mixtral-8x7b
Language:Python 12
potproject / uchinoko-studio
Uchinoko Studio is a web application designed to facilitate real-time voice conversations with AI.
bert-vits2 gpt-4 web whisper claude style-bert-vits2 voicevox local-llm
Language:Svelte 11
TinToSer / GPT4Docs
An Offline Document Enquiry LLM for Everyone
gpt4docs gpt llama2 llm local offline privacy qa llm4docs qa-document local-gpt local-llm llm-qa-document offline-gpt offline-llm offline-qa private-qa-document langchain llama-2
Language:Python 10
Belluxx / LlamaTerm
Use your open source local model from the terminal
llama llamacpp cli-app language-model llama-cpp mistral mistral-7b local-llm
Language:Python 7
kpcyrd / summarize-cli
Attempt to summarize text from `stdin`, using a large language model (locally and offline), to `stdout`
llama2 llm local-llm offline-llm text-processing
Language:Rust 6
Likhithsai2580 / JARVIS
Project Jarvis is a versatile AI assistant that integrates various functionalities.
agent agents assistant g4f gui jarvis local-llm multifunctional multithreading ocr offline online open-source python tonystark voice voice-assistant wakeword
Language:Python 6
h1ddenpr0cess20 / ollamarama
Terminal based AI chatbot with infinite personalities, using local LLMs
ai chatbot litellm local-llm ollama
Language:Python 4
lori-assistant / frontend
User interface for a ChatGPT-like chatbot powered by a local Ollama AI server, with support for plugins in the future
ai artificial-intelligence large-language-models llama llama2 llm local-llm ollama
Language:Dart 4
lennartpollvogt / ollama-instructor
Instruct and validate structured outputs from LLMs with Ollama.
json-schema llm ollama pydantic local-llm validation instructor prompting json
Language:Python 3
Abhi5h3k / LLQuery
LLQuery : Your Conversational SQL Bridge Harness the power of natural language to effortlessly craft SQL queries with LLQuery.
chainlit chatgpt docker duckdb gpt llm local-llm ollama sql gpt-database gpt-sql simple-gpt langchain
Language:Python 2
dmeldrum6 / LocalLLMChat
Serverless single HTML page access to an OpenAI API compatible Local LLM
html-css-javascript lm-studio local-llm openai-api
Language:HTML 2
Govind-S-B / ppt_generator
A local LLM assisted ppt generation tool
automation llms local-llm presentation python-pptx streamlit
Language:Python 2
gustavostz / Local-AI-Open-Orca-For-Dummies
Local AI Open Orca For Dummies is a user-friendly guide to running Large Language Models locally. Simplify your AI journey with easy-to-follow instructions and minimal setup. Perfect for developers tired of complex processes!
ai easy-to-use for-dummies large-language-model large-language-models llm llms local-ai local-llm localai localllm openorca open-orca
Language:Python 2
harehimself / crewai-local-llm
CrewAI Local LLM is a GitHub repository for a locally hosted large language model (LLM) designed to enable private, offline AI model usage and experimentation.
crew crewai experimental llm local-llm ollama ollama-client
Language:Python 1
kristofferv98 / SemanthaVoiceAssistant
A comprehensive AI companion leveraging advanced semantic analysis, sentiment detection, and voice processing to provide personalized and context-aware interactions using Autogen, semantic-router, and VoiceProcessingToolkit.
autogen elevenlabs intent-detection local-llm natural-language-processing openai picovoice python rag sentiment-analysis text-to-speech voice-activity-detection voice-assistant voice-processing voice-recognition websearch whisper ai-companion personalized-interactions semantic-routing
Language:Python 1
macie / boludo
Terminal UI for locally hosted large language models
cli gguf llama llm local-llm
Language:Go 1
manthan89-py / DataWhisperer
Data Whisperer is a chatbot that allows you to analyze your local files using Large Language Models (LLMs). You can upload PDFs, Markdown, Text, and Document files to the chatbot and then ask questions related to the content of these files.
chatbot file-analyzer langchain langchain-python llm local-llm python reactjs
Language:Python 1
MOONLAPSED / cognOS
Python package for cognosis kb, syntax, and markup language. Under-construction.
agent llama2 local-llm rlhf
Language:Python 1
gdifiore / askdotmd
chatgpt in your vscode
ai-coder ask askdotmd chatbot chatgpt code-assistant llm lmstudio local-llm vscode yacinemtb
Language:TypeScript 0
alexkreidler / quote-constraint
A constrained generation filter for local LLMs that makes them quote properly from a source document
exllama llm local-llm constrained-generation
Language:Python
Tudor44 / spring-aI-with-local-LLAMA3
This demo demonstrates the integration of a local LLama3 model for handling JSON responses within the Spring AI framework, positioning the model as a 'business logic' executor
ai generative-ai java llama3 llm local-llm rag spring-ai
Language:Java

local-llm

Mintplex-Labs / anything-llm

langroid / langroid

lxe / llavavision

withcatai / catai

shreyaskarnik / DistiLlama

nath1295 / LLMFlex

AstraBert / everything-ai

Fus3n / TwoAI

xtekky / gpt4local

gsuuon / ad-llama

Picovoice / pico-cookbook

emirsahin1 / llm-axe

ShelbyJenkins / llm_client

Fus3n / infinite-sides

edgett / PalmHill.BlazorChat

J4NN0 / llm-rag

potproject / uchinoko-studio

TinToSer / GPT4Docs

Belluxx / LlamaTerm

kpcyrd / summarize-cli

Likhithsai2580 / JARVIS

h1ddenpr0cess20 / ollamarama

lori-assistant / frontend

lennartpollvogt / ollama-instructor

Abhi5h3k / LLQuery

dmeldrum6 / LocalLLMChat

Govind-S-B / ppt_generator

gustavostz / Local-AI-Open-Orca-For-Dummies

harehimself / crewai-local-llm

kristofferv98 / SemanthaVoiceAssistant

macie / boludo

manthan89-py / DataWhisperer

MOONLAPSED / cognOS

gdifiore / askdotmd

alexkreidler / quote-constraint

Tudor44 / spring-aI-with-local-LLAMA3