smiraldr

gpu-alpha

VictoriaMetrics

VictoriaMetrics: fast, cost-effective monitoring solution and time series database

LLMLingua

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

recommenders

Best Practices on Recommendation Systems

mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

LocationSimulator

MacOS application to spoof / fake / mock your iOS / iPadOS or iPhoneSimulator device location. WatchOS and TvOS are partially supported.

AI-Persona

AI Persona in JSON file

llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

configs

LM Studio JSON configuration file format and a collection of example config files.

ollama

Get up and running with Llama 3, Mistral, Gemma 2, and other large language models.

mlx-examples

Examples in the MLX framework

mlx

MLX: An array framework for Apple silicon

Machine-Learning-for-Imbalanced-Data

Machine Learning for Imbalanced Data, published by Packt

xllm

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

voyager

🛰️ An approximate nearest-neighbor search library for Python and Java with a focus on ease of use, simplicity, and deployability.

netmaker

Netmaker makes networks with WireGuard. Netmaker automates fast, secure, and distributed virtual networks.

OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run SDXL on a RPI Zero 2 but also Mistral 7B on desktops and servers.

llm-applications

A comprehensive guide to building RAG-based LLM applications for production.

DiffBIR

Official codes of DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior

langfuse

🪢 Open source LLM engineering platform: Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

open-interpreter

A natural language interface for computers

SuperAGI

<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

shell-ai

LangChain powered shell command generator and runner CLI

devpod

Codespaces but open-source, client-only and unopinionated: Works with any IDE and lets you use any cloud, kubernetes or just localhost docker.

litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

Fooocus

Focus on prompting and generating

ml-fastvit

This repository contains the official implementation of the research paper, "FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterization" ICCV 2023

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

ray-llm

RayLLM - LLMs on Ray

OpenLLM

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.