maxgreco

cake

Distributed LLM inference for mobile, desktop and server.

llm-twin-course

🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 11 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴

AIlice

AIlice is a fully autonomous, general-purpose AI agent.

Verba

Retrieval Augmented Generation (RAG) chatbot powered by Weaviate

aTrain

A GUI tool for offline transcription of speech recordings, including speaker diarization, utilizing state-of-the-art machine learning models.

lobe

Lobe is a free easy-to-use tool for Mac and PC that helps you train machine learning models and ship them to any platform you choose.

DeOldify

A Deep Learning based project for colorizing and restoring old images (and video!)

label-studio

Label Studio is a multi-type data labeling and annotation tool with standardized output format

ml-hub

🧰 Multi-user development platform for machine learning teams. Simple to setup within minutes.

ml-workspace

🛠 All-in-one web-based IDE specialized for machine learning and data science.

TagUI

Free RPA tool by AI Singapore

storm

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

anole

Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation

llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

VILA

VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

image-interrogator

The IMAGE-interrogator for SOTA image captioning

taggui

Tag manager and captioner for image datasets

OpenContracts

Mass document analytics platform based on LlamaIndex, Pgvector, React and Django.

llama-agents

LongVA

Long Context Transfer from Language to Vision

MoA

Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models

Video-LLaMA

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

DevToys

A Swiss Army knife for developers.

SubProber

Subprober is a powerful and efficient subdomain scanning tool written in Python. With the ability to handle large lists of subdomains. The tool offers concurrent scanning, allowing users to define their preferred concurrency level for faster results. Whether you are on Linux, Windows, or macos

whisper-web

ML-powered speech recognition directly in your browser

pgai

Bring AI models closer to your PostgreSQL data

llama-zip

LLM-powered lossless compression tool

gollama

Go manage your Ollama models

zeus

Deep Learning Energy Measurement and Optimization

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.