lucatume

ollama

Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.

llama.cpp

LLM inference in C/C++

privateGPT

Interact with your documents using the power of GPT, 100% privately, no data leaks

open-interpreter

A natural language interface for computers

text-generation-webui

A Gradio web UI for Large Language Models.

LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference

tabby

Self-hosted AI coding assistant

fauxpilot

FauxPilot - an open-source alternative to GitHub Copilot server

shell_gpt

A command-line productivity tool powered by AI large language models like GPT-4, will help you accomplish your tasks faster and more efficiently.

reor

Private & local AI personal knowledge management app.

grip

Preview GitHub README.md files locally before committing them.

krita-ai-diffusion

Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.

latent-consistency-model

Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference

promptfoo

Test your prompts, agents, and RAGs. Redteaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

localpilot

terrain

Fantasy map generator

twinny

The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but completely free and 100% private.

macOSpilot-ai-assistant

Voice + Vision powered AI assistant that answers questions about any application, in context and in audio.

SeaGOAT

local-first semantic code search engine

CodeGPT

JetBrains extension providing access to state-of-the-art LLMs, such as GPT-4, Claude 3, Code Llama, and others, all for free

awesome-assistants

A curated list of awesome AI assistants. Example Telegram bot with all these assistants can be tested on the link below.

homebrew-formula

catai

Run AI ✨ assistant locally! with simple API for Node.js 🚀

rund

OCI Container Runtime for macOS

oink

🐽 oink.php is a single-file PHP library to easily build APIs

langchain-php

⚡ Building applications with LLMs through composability in PHP ⚡

latent-consistency-model

Run Latent Consistency Models on your Mac

llama-cpp-php

The package enables the use of the LLama C++ library in PHP, thereby allowing the setup and execution of LLM models in PHP on your local machine.

byte-level-care

Living with zero problems while developing your web application

llama-cpp-php-linux-lib

Linux binary library for llama.cpp packaged as composer dependency