mzbac

qlora-fine-tune

llama2-fine-tune

Scripts for fine-tuning Llama2 via SFT and DPO.

wizardCoder-vsc

Visual Studio Code extension for WizardCoder

AutoGPTQ-API

Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.

mlx-moe

Scripts to create your own moe models using mlx

mlx-llm-server

For inferring and serving local LLMs using the MLX framework

mlx-chat-ui

huggingface chat-ui integration with mlx-lm server

GPTQ-for-LLaMa-API

Provide a way to use the GPT-QLLama model as an API

mlx-lora

gptq-cuda-api

swift-mlx-server

LLM_Web

Host LLM via text-generation-inference

qlora-inference-multi-gpu

LLM_web_apple_silicon

mlx-moe-models

linkedin-message-assistant

llama.cpp-docker

mlx-examples

Examples in the MLX framework

CV_Assistant

Help refine your CV for a specific job description.

llama-cpp-python

Python bindings for llama.cpp

codeguard

enchanted

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

maestro

A framework for Claude Opus to intelligently orchestrate subagents.

maestro-web

an chrome extension for maestro, so you don't have to run it via python

mlx

MLX: An array framework for Apple silicon

mlx-swift-examples

Examples using MLX Swift

redirectly

chrome extension for web development

rust-candle-example

swift-transformers

Swift Package to implement a transformers-like API in Swift

text-generation-webui

A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.