Peter Yu's starred repositories
haystack
:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
awesome-tunneling
List of ngrok/Cloudflare Tunnel alternatives and other tunneling software and services. Focus on self-hosting.
RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
ffmpeg-libav-tutorial
FFmpeg libav tutorial - learn how media works from basic to transmuxing, transcoding and more. Translations: πΊπΈ π¨π³ π°π· πͺπΈ π»π³ π§π·
DeepSpeedExamples
Example models using DeepSpeed
open_flamingo
An open-source framework for training large multimodal models.
LLM-As-Chatbot
LLM as a Chatbot Service
pytorchvideo
A deep learning library for video understanding research.
Video-LLaMA
[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
Image2Paragraph
[A toolbox for fun.] Transform Image into Unique Paragraph with ChatGPT, BLIP2, OFA, GRIT, Segment Anything, ControlNet.
pytorch-coviar
Compressed Video Action Recognition
llama-docker-playground
Quick Start LLaMA models with multiple methods, and fine-tune 7B/65B with One-Click.
chat-with-nerf
Chat with NeRF enables users to interact with a NeRF model by typing in natural language.
mv-extractor
Extract frames and motion vectors from H.264 and MPEG-4 encoded video.
cv_emulate
Academic CVs that you can emulate
RGB-no-more
An official code release of the paper RGB no more: Minimally Decoded JPEG Vision Transformers
Compressed-Video-Reader
A video reader for extracting motion vectors and residuals from encoded H.264 videos.
gufi-archive
Public Repo of documentation and scripts how to use GUFI to generate reports to identify data suitable for archive