llamacpp

There are 31 repositories under llamacpp topic.

menloresearch / jan
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer
llama2 llamacpp localai self-hosted gpt tauri
Language:TypeScript 37838
khoj
khoj-ai / khoj
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.
semantic-search emacs obsidian-md chat chatgpt ai llm productivity agent self-hosted rag whatsapp-ai offline-llm llamacpp obsidian llama3 image-generation stt assistant research
Language:Python 30970
llmware-ai / llmware
Unified framework for building enterprise RAG pipelines with small, specialized models
parsing retrieval-augmented-generation agents generative-ai-tools llamacpp llm small-specialized-models onnx openvino
Language:Python 14441
getumbrel / llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
ai chatgpt gpt gpt-4 gpt4all llama llama-2 llama-cpp llama2 llamacpp llm localai openai self-hosted code-llama codellama
Language:TypeScript 11001
xorbitsai / inference
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
ggml pytorch chatglm deployment flan-t5 llm wizardlm artificial-intelligence machine-learning whisper inference openai-api mistral gemma llama llamacpp vllm qwen llama3 glm4
Language:Python 8525
reorproject / reor
Private & local AI personal knowledge management app for high entropy people.
ai lancedb llama llamacpp local-first markdown note-taking pkm vector-database rag second-brain ollama
Language:JavaScript 8249
LostRuins / koboldcpp
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
koboldcpp llamacpp llm koboldai llama ggml gguf gemma language-model mistral
Language:C++ 8193
serge
serge-chat / serge
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
llama alpaca docker fastapi llamacpp python web svelte sveltekit tailwindcss nginx
Language:Svelte 5751
spark-nlp
JohnSnowLabs / spark-nlp
State of the Art Natural Language Processing
nlp natural-language-processing spark pyspark named-entity-recognition sentiment-analysis lemmatizer spell-checker entity-extraction part-of-speech-tagger bert transformers tensorflow language-detection machine-translation text-classification llm question-answering llamacpp onnx
Language:Scala 4042
gptme / gptme
Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web, vision.
ai-agents ai-assistant anthropic chatbot chatgpt cli code-generation llamacpp llm llm-agent llm-apps openai openrouter rag
Language:Python 3711
twinnydotdev / twinny
The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but 100% free.
artificial-intelligence code-generation vscode-extension code-completion copilot codellama llama2 ollama ollama-api code-chat free ollama-chat private llamacpp symmetry
Language:TypeScript 3596
SciSharp / LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
chatbot gpt llama llamacpp llm semantic-kernel llava multi-modal llama2 llama3 llama-cpp
Language:C# 3354
lsp-ai
SilasMarvin / lsp-ai
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
ai auto-completion developer-tools ide language-client llama llamacpp llm lsp mistral openai self-hosted
Language:Rust 2987
Josh-XT / AGiXT
AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
agent-llm agi agixt ai artificial automation chromadb intelligence llama llamacpp llm llmops openai python
Language:Python 2965
menloresearch / cortex.cpp
Local AI API Platform
gguf llamacpp onnx onnxruntime
Language:C++ 2761
maid
Mobile-Artificial-Intelligence / maid
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
android chatbot chatgpt facebook flutter gguf large-language-models llama llama-cpp llama2 llamacpp mistral openai openorca local-ai ollama mobile-ai android-ai mobile-artificial-intelligence free-chatgpt
Language:Dart 2153
floneum / floneum
Instant, controllable, local pre-trained AI models in Rust
ai llm rust llamacpp kalosm candle llama mistral floneum-v3 dioxus constrained-generation transcription whisper
Language:Rust 1826
Dot
alexpinel / Dot
Text-To-Speech, RAG, and LLMs. All local!
embeddings llm local rag standalone standalone-app document-chat faiss langchain privategpt llamacpp self-hosted phi-3 tts whisper-cpp
Language:JavaScript 1778
containers / ramalama
The goal of RamaLama is to make working with AI boring.
ai containers inference-server llamacpp llm podman vllm
Language:Python 1510
LlamaChat
alexrozanski / LlamaChat
Chat with your favourite LLaMA models in a native macOS app
ai llama llamacpp machine-learning macos swift swiftui
Language:Swift 1500
RahulSChand / gpu_poor
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
ggml huggingface llm quantization gpu language-model pytorch llama llama2 llamacpp
Language:JavaScript 1354
vercel / modelfusion
The TypeScript library for building AI applications.
chatbot gpt-3 javascript js llm openai ts typescript whisper ai embedding huggingface dall-e stable-diffusion llamacpp artificial-intelligence claude multi-modal ollama mistral
Language:TypeScript 1300
awaescher / OllamaSharp
The easiest way to use Ollama in .NET
llm ollama ollama-api llama ai gpt llamacpp localllama streaming microsoft-extensions-ai ichatclient
Language:C# 1127
Dicklesworthstone / swiss_army_llama
A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.
embedding-similarity embedding-vectors embeddings llama2 llamacpp semantic-search
Language:Python 1014
Atome-FE / llama-node
Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.
ai gpt large-language-models llama llama-rs llm napi napi-rs nodejs llama-node embeddings llamacpp langchain rwkv
Language:Rust 870
huggingface / llm-ls
LSP server leveraging LLMs for code completion (and more?)
ai code-generation huggingface ide llamacpp llm lsp lsp-server openai self-hosted
Language:Rust 818
mukel / llama3.java
Practical Llama 3 inference in Java
java llama llama3 llm llm-inference llms chatgpt genai gguf huggingface llamacpp openai simd transformers
Language:Java 781
distantmagic / paddler
Stateful load balancer custom-tailored for llama.cpp 🏓🦙
ai llamacpp llm llmops load-balancer
Language:Rust 735
ngxson / wllama
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
llama llamacpp llm wasm webassembly
Language:TypeScript 652
if-ai / ComfyUI-IF_AI_tools
ComfyUI-IF_AI_tools is a set of custom nodes for ComfyUI that allows you to generate prompts using a local Large Language Model (LLM) via Ollama. This tool enables you to enhance your image generation workflow by leveraging the power of language models.
anthropic comfyui flux gemini graphrag groq koboldcpp llamacpp lmstudio mistral ocr ollama omost rag stable-diffusion supervision textgeneration transformers xai
Language:Python 623
xNul / code-llama-for-vscode
Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
code-llama code llama studio visual vscode llm local continue copilot llamacpp continuedev llama2 meta ollama codellama assistant
Language:Python 568
llama-cpp-agent
Maximilian-Winter / llama-cpp-agent
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
agents function-calling llamacpp llm llm-agent llm-framework llms parallel-function-call
Language:Python 550
mostlygeek / llama-swap
Model swapping for llama.cpp (or any local OpenAPI compatible server)
golang llama llamacpp localllama localllm openai openai-api vllm
Language:Go 506
pythops / tenere
🤖 TUI interface for LLMs written in Rust
chatgpt llm rust tui cli ratatui llamacpp ollama
Language:Rust 502
lxe / llavavision
A simple "Be My Eyes" web app with a llama.cpp/llava backend
ai artificial-intelligence computer-vision llama llamacpp llm local-llm machine-learning multimodal webapp
Language:JavaScript 489
fynnfluegge / codeqai
Local first semantic code search and chat | Leverage custom copilots with fine-tuning datasets from code in Alpaca, Conversational, Completion and Instruction format
codellama faiss gpt huggingface langchain llama2 llamacpp llm ollama openai sentence-transformers
Language:Python 470

llamacpp

menloresearch / jan

khoj-ai / khoj

llmware-ai / llmware

getumbrel / llama-gpt

xorbitsai / inference

reorproject / reor

LostRuins / koboldcpp

serge-chat / serge

JohnSnowLabs / spark-nlp

gptme / gptme

twinnydotdev / twinny

SciSharp / LLamaSharp

SilasMarvin / lsp-ai

Josh-XT / AGiXT

menloresearch / cortex.cpp

Mobile-Artificial-Intelligence / maid

floneum / floneum

alexpinel / Dot

containers / ramalama

alexrozanski / LlamaChat

RahulSChand / gpu_poor

vercel / modelfusion

awaescher / OllamaSharp

Dicklesworthstone / swiss_army_llama

Atome-FE / llama-node

huggingface / llm-ls

mukel / llama3.java

distantmagic / paddler

ngxson / wllama

if-ai / ComfyUI-IF_AI_tools

xNul / code-llama-for-vscode

Maximilian-Winter / llama-cpp-agent

mostlygeek / llama-swap

pythops / tenere

lxe / llavavision

fynnfluegge / codeqai