George's repositories
ChartAst
ChartAssistant is a chart-based vision-language model for universal chart comprehension and reasoning.
cardie
An open source business card designer and sharing platform
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
trl
Train transformer language models with reinforcement learning.
MiniCPM-V
MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone
YOLO-World
[CVPR 2024] Real-Time Open-Vocabulary Object Detection
Auto-GUI
Official implementation for "You Only Look at Screens: Multimodal Chain-of-Action Agents" (Findings of ACL 2024)
InternLM-XComposer
InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output
lerobot
🤗 LeRobot: End-to-end Learning for Real-World Robotics in Pytorch
digirl
Official repo for paper DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning.
Open-LLaVA-NeXT
An open-source implementation for training LLaVA-NeXT.
mpa-archive
Crawls a Multi-Page Application to a zip file, serve the Multi-Page Application from the zip file. A MPA archiver. Could be used as a Site Generator
mmbench-ru-eval
Repository to simple evaluation your results on MMBench-DEV-RU
VLMEvalKit
Open-source evaluation toolkit of large vision-language models (LVLMs), support GPT-4v, Gemini, QwenVLPlus, 40+ HF models, 20+ benchmarks
kosmos-2.5-gradio
Script to easy (from the bbox inference and deployment) of kosmos-2.5
screenshot-to-code
Drop in a screenshot and convert it to clean code (HTML/Tailwind/React/Vue)
RL4VLM
Official Repo for Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning
MoneyPrinterTurbo
Generate short videos with one click using AI LLM.
Discffusion
Official repo for the paper "Discffusion: Discriminative Diffusion Models as Few-shot Vision and Language Learners"
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
conditional-flow-matching
TorchCFM: a Conditional Flow Matching library
SeeClick
The model, data and code for the visual GUI Agent SeeClick
NeuralFlow
Visualize the intermediate output of Mistral 7B
SeeAct
SeeAct is a system for generalist web agents that autonomously carry out tasks on any given website, with a focus on large multimodal models (LMMs) such as GPT-4V(ision).
vimGPT
Browse the web with GPT-4V and Vimium
llama2d
2D Positional Embeddings for Webpage Structural Understanding 🦙👀
self-operating-computer
A framework to enable multimodal models to operate a computer.
goodcatch
Open-source attempt to implement tiny vision-language model which works well with text-rich images