George's repositories
Auto-GUI
Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)
cardie
An open source business card designer and sharing platform
conditional-flow-matching
TorchCFM: a Conditional Flow Matching library
digirl
Official repo for paper DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning.
Discffusion
Official repo for the paper "Discffusion: Discriminative Diffusion Models as Few-shot Vision and Language Learners"
InternLM-XComposer
InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output
kosmos-2.5-gradio
Script to easy (from the bbox inference and deployment) of kosmos-2.5
lerobot
🤗 LeRobot: End-to-end Learning for Real-World Robotics in Pytorch
llama2d
2D Positional Embeddings for Webpage Structural Understanding 🦙👀
MiniCPM-V
MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone
mmbench-ru-eval
Repository to simple evaluation your results on MMBench-DEV-RU
MoneyPrinterTurbo
Generate short videos with one click using AI LLM.
moondream
tiny vision language model
mpa-archive
Crawls a Multi-Page Application to a zip file, serve the Multi-Page Application from the zip file. A MPA archiver. Could be used as a Site Generator
Open-LLaVA-NeXT
An open-source implementation for training LLaVA-NeXT.
RL4VLM
Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning
screenshot-to-code
Drop in a screenshot and convert it to clean code (HTML/Tailwind/React/Vue)
SeeAct
SeeAct is a system for generalist web agents that autonomously carry out tasks on any given website, with a focus on large multimodal models (LMMs) such as GPT-4V(ision).
SeeClick
The model, data and code for the visual GUI Agent SeeClick
self-operating-computer
A framework to enable multimodal models to operate a computer.
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
trl
Train transformer language models with reinforcement learning.
vimGPT
Browse the web with GPT-4V and Vimium
VLMEvalKit
Open-source evaluation toolkit of large vision-language models (LVLMs), support GPT-4v, Gemini, QwenVLPlus, 40+ HF models, 20+ benchmarks
YOLO-World
[CVPR 2024] Real-Time Open-Vocabulary Object Detection