gui-agent

There are 5 repositories under gui-agent topic.

• bytedance / UI-TARS-desktop

  The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra

  agentagent-tarsbrowser-usecomputer-usegui-agentgui-operatormcpmcp-servermultimodaltarsui-tarsvisionvlm
  Language:TypeScript 19430

• showlab / ShowUI

  [CVPR 2025] Open-source, End-to-end, Vision-Language-Action model for GUI Agent & Computer Use.

  agentcomputer-usegui-agentvision-language-actionvision-language-model
  Language:Python 1542

• trycua / acu

  A curated list of resources about AI agents for Computer Use, including research papers, projects, frameworks, and tools.

  aiai-researchawesomecomputercomputer-usegui-agentui-agent
  1500

• zai-org / CogAgent

  An open-sourced end-to-end VLM-based GUI Agent

  gui-agentcomputer-usevlmagentglm
  Language:Python 1081

• OS-Agent-Survey / OS-Agent-Survey

  This is the repo for the paper "OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use" (ACL 2025 Oral).

  agentbrowser-agentcomputer-usecomputer-usingcomputer-using-agentcomputing-devicesguigui-agentllmsmllmsoperatoros-agentos-agent-surveyphone-usesurveyweb-agent
  364

• ritzz-ai / GUI-R1

  Official implementation of GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents

  deep-reinforcement-learninggui-agentlarge-multimodal-modelsmllm-reasoningmultimodalmultimodal-large-language-modelsr1grpoo1
  Language:Python 198

• SunzeY / SEAgent

  Official implementation of "SEAgent: Self-Evolving Computer Use Agent with Autonomous Learning from Experience"

  agentcomputer-use-agentgrpogui-agentosworldrlself-evolving-systemsvllm
  Language:Python 190

• lll6gg / UI-R1

  Code for "UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning"

  efficient-reasoninggui-agentmultimodal-large-language-modelsmultimodal-learningr1reinforcement-learning
  Language:Python 130

• InfiXAI / InfiGUI-G1

  Official repository for InfiGUI-G1. We introduce Adaptive Exploration Policy Optimization (AEPO) to overcome semantic alignment bottlenecks in GUI agents through efficient, guided exploration.

  computer-visiondeep-learninggui-agentgui-groundinglarge-language-modelsmultimodal-llmreinforcement-learning
  Language:Python 111

• showlab / WorldGUI

  Enable AI to control your PC. This repo includes the WorldGUI Benchmark and GUI-Thinker Agent Framework.

  agentsgui-agentgui-applicationlarge-multimodal-models
  Language:Python 94

• wendell0218 / GVA-Survey

  Official repository of the paper "Generalist Virtual Agents: A Survey on Autonomous Agents Across Digital Platforms"

  embodied-agentgeneralist-virtual-agentgui-agentgvallmmllmmulti-agent-systemsurveyvirtual-agentvlm
  82

• open-compass / MMBench-GUI

  Official repo of "MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents". It can be used to evaluate a GUI agent with a hierarchical manner across multiple platforms, including Windows, Linux, macOS, iOS, Android and Web.

  benchmark-frameworkcomputer-usegui-agentvision-language-model
  Language:Python 77

• TurixAI / TuriX-CUA

  This is the official website for TuriX Computer-use-Agent

  agentai-agentsbrowser-usecomputer-automationcomputer-usecomputer-use-agentcuagui-agentgui-operatormcp
  Language:Python 72
• TongUI-agent

  TongUI-agent / TongUI-agent

  Release of code, datasets and model for our work TongUI: Building Generalized GUI Agents by Learning from Multimodal Web Tutorials

  agentcomputer-usecomputer-use-agentgui-agenttonguivision-language-actionvision-language-action-modelvision-language-model
  Language:HTML 55

• ahnjaewoo / FlashAdventure

  🕵 Code for our EMNLP 2025 Main paper: "FlashAdventure: A Benchmark for GUI Agents Solving Full Story Arcs in Diverse Adventure Games"

  gui-agentagentcomputer-usecomputer-using-agentembodied-agentgame-agentvision-language-modelvlm
  Language:Python 15

• V-Droid-Agent / V-Droid

  Source code of the paper "V-Droid: Advancing Mobile GUI Agent Through Generative Verifiers"

  agentcomputer-usegui-agentllmphone-usemobilemobile-agents
  Language:Python 10

• Magic-Abracadabra / AI-Chinese-Scripting-Language

  This is a quick test of Chinese Scripting Language powered by AI. You can use it to open any text file. No illegal use is allowed! Free for commercial use and academic use.

  context-engineeringgui-agentprompt-engineering
  Language:Python 2

• Magic-Abracadabra / AI-Chinese-Scripting-Language-Linux

  Control Group of My Future Paper, without Task Planning, Exceptional Handling, and fully based on LLMs

  computer-usecontext-engineeringgui-agentlinuxprompt-engineering
  Language:Python 0

• Yah185 / open-source-operator

  Create your self-hosted, open-source Operator model.

  agent-evalsbrowserusegui-agentnative-agent-modeltraining-infra
  0