mitkox

LLM101n

LLM101n: Let's build a Storyteller

LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference

graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system

pgvector

Open-source vector similarity search for Postgres

mistral-inference

Official inference library for Mistral models

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

corenet

CoreNet: A library for training deep neural networks

postgresml

Postgres with GPUs for ML/AI apps.

LLocalSearch

LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.

alignment-handbook

Robust recipes to align language models with human and AI preferences

sqlite-vec

A vector search SQLite extension that runs anywhere!

cohere-toolkit

Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.

mistral-finetune

ml-fastvit

This repository contains the official implementation of the research paper, "FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterization" ICCV 2023

axlearn

An Extensible Deep Learning Library

Phi-3CookBook

This is a Phi-3 book for getting started with Phi-3. Phi-3, a family of open AI models developed by Microsoft. Phi-3 models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks.

llm-datasets

High-quality datasets, tools, and concepts for LLM fine-tuning.

fsdp_qlora

Training LLMs with QLoRA + FSDP

rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

pgvectorscale

A complement to pgvector for high performance, cost efficient vector search on large workloads.

pgai

Bring AI models closer to your PostgreSQL data

SPPO

The official implementation of Self-Play Preference Optimization (SPPO)

cosmopedia

ava

All-in-one desktop app for running LLMs locally.

PicoMLXServer

The easiest way to run the fastest MLX-based LLMs locally

openinference

Auto-Instrumentation for AI Observability

mlxserver

Start a server from the MLX library.

cohere-terrarium

A simple Python sandbox for helpful LLM data agents

Ctrl-G

function-calling-eval

A framework for evaluating function calls made by LLMs