mudler

llama.cpp

LLM inference in C/C++

grok-1

Grok open release

llama3

The official Meta Llama 3 GitHub site

LocalAI

:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

llm.c

LLM training in simple, raw C/CUDA

alpaca.cpp

Locally run an Instruction-Tuned Chat-Style LLM

LWM

syft

CLI tool and library for generating a Software Bill of Materials from container images and filesystems

big-AGI

Generative AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

ml-mgie

awesome-mlops

:sunglasses: A curated list of awesome MLOps tools

jepa

PyTorch code and models for V-JEPA self-supervised learning from video.

intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

kubectl-ai

✨ Kubectl plugin for OpenAI GPT

Stable-Diffusion-NCNN

Stable Diffusion in NCNN with c++, supported txt2img and img2img

GenossGPT

One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) 🌈🐂 Replace OpenAI GPT with any LLMs in your app with one line.

go-llama.cpp

LLama.cpp golang bindings

bert.cpp

ggml implementation of BERT

LocalAGI

100% Local AGI with LocalAI

aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

localai-vscode-plugin

🤖👨‍💻 Extension for attaching LocalAI instance to VSCode, LabLab Open Source AI Hackathon Submission

homeassistant-localai

LocalAI integration component for Home Assistant

chatapi

💭 ChatGPT by API

localai-admin

go-rwkv.cpp

A go wrapper around the rwkv.cpp library

spectromate

An API server designed for creating Slack Applications

voice-assistant

A Voice Assistant in your Browser.

awesome-av

A repository committed to tracking the best tools, platforms, and resources for helping AV (audiovisual) software engineers advance their skills and get shit done faster.

shepard

Free, local, declarative cluster analysis using K8SGPT + LocalAI, your data never leaves the cluster.

carotte

🥕 Symfony + Ollama/OpenAI + Turbo + Mercure playground.