maxgreco

multimodal-maestro

Effective prompting for Large Multimodal Models like GPT-4 Vision, LLaVA or CogVLM. 🔥

shiny-standalone-webr-demo

Demonstration of using a JavaScript ServiceWorker to communicate with a running Shiny/httpuv session in webR.

webr.bundle

Bundle Shiny Applications for serving with WebR.

dsnote

Speech Note Linux app. Note taking, reading and translating with offline Speech to Text, Text to Speech and Machine translation.

llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

hydrus

A personal booru-style media tagger that can import files and tags from your hard drive and popular websites. Content can be shared with other users via user-run servers.

LLMLingua

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

machinascript-for-robots

Build LLM-powered robots in your garage with MachinaScript For Robots!

MoE-LLaVA

Mixture-of-Experts for Large Vision-Language Models

RWKV-Runner

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.

BioGPT

TensorFlow-CUDA-Windows-Installation-Guide

TensorFlow 2 with GPU on Windows: Step-by-step instructions how install CUDA and cuDNN on Windows to use TensorFlow with GPU support

CUDA-Install-Guide

Installation guide for NVIDIA driver, CUDA, cuDNN and TensorRT

BakLLaVA

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Vim

[ICML 2024] Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model

surya

OCR, layout analysis, reading order, line detection in 90+ languages

jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

wslcompact

Compacts the size of the ever-growing WSL vhdx images.

open-interpreter

A natural language interface for computers

ColBERT

ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)

Video-LLaVA

Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

VCoder

VCoder: Versatile Vision Encoders for Multimodal Large Language Models, arXiv 2023 / CVPR 2024

crewAI

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

unsloth

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

mamba-chat

Mamba-Chat: A chat LLM based on the state-space model architecture 🐍

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

txtai

💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

KoboldAI-Client