computer-use

There are 64 repositories under computer-use topic.

• bytedance / UI-TARS-desktop

  The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra

  agentagent-tarsbrowser-usecomputer-usegui-agentgui-operatormcpmcp-servermultimodaltarsui-tarsvisionvlm
  Language:TypeScript 19429

• trycua / cua

  Open-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and benchmarks to train and evaluate AI agents that can control full desktops (macOS, Linux, Windows).

  agentai-agentapplecomputer-usecomputer-use-agentcontainerizationcuadesktop-automationhacktoberfestlumemacosmanusoperatorswiftvirtualizationvirtualization-frameworkwindowswindows-sandbox
  Language:Python 11202

• web-infra-dev / midscene

  Your AI Operator for Web, Android, Automation & Testing.

  aiai-testbrowser-usecomputer-usegpt-operatorjavascriptphone-usetesting
  Language:TypeScript 10641

• bytebot-ai / bytebot

  Bytebot is a self-hosted AI desktop agent that automates computer tasks through natural language commands, operating within a containerized Linux desktop environment.

  agentagentic-aiagentsaiai-agentsai-toolsanthropicautomationbytebotcomputer-usecomputer-use-agentcuadesktopdesktop-automationdockergeminillmmcpopenai
  Language:TypeScript 9469

• simular-ai / Agent-S

  Agent S: an open agentic framework that uses computers like a human

  agent-computer-interfaceai-agentscomputer-automationgui-agentsmemorymllmplanningretrieval-augmented-generationin-context-reinforcement-learningcomputer-usegroundingcomputer-use-agentcua
  Language:Python 8076
• Upsonic

  Upsonic / Upsonic

  Agent Framework For Fintech

  agentagent-frameworkclaudecomputer-usellmsmcpmodel-context-protocolopenairagreliability
  Language:Python 7677

• A9T9 / RPA

  Ui.Vision Open-Source RPA Software with Computer Vision, OCR, Anthropic Computer Use/LLM. Selenium IDE import/export.

  web-automationselenium-ideimacrosbrowser-extensionbrowser-automationdata-driven-testsweb-scrapinganthropicanthropic-claudecomputer-use
  Language:JavaScript 1766

• e2b-dev / open-computer-use

  AI computer use powered by open source LLMs and E2B Desktop Sandbox

  agentaianthropicclaudecomputer-usellm
  Language:Python 1636

• showlab / ShowUI

  [CVPR 2025] Open-source, End-to-end, Vision-Language-Action model for GUI Agent & Computer Use.

  agentcomputer-usegui-agentvision-language-actionvision-language-model
  Language:Python 1542

• trycua / acu

  A curated list of resources about AI agents for Computer Use, including research papers, projects, frameworks, and tools.

  aiai-researchawesomecomputercomputer-usegui-agentui-agent
  1501
• OpenAdapt

  OpenAdaptAI / OpenAdapt

  Open Source Generative Process Automation (i.e. Generative RPA). AI-First Process Automation with Large ([Language (LLMs) / Action (LAMs) / Multimodal (LMMs)] / Visual Language (VLMs)) Models

  process-automationpythontransformerslarge-language-modelslarge-multimodal-modelshuggingfacesegment-anythinglarge-action-modelprocess-miningagentsai-agentsai-agents-frameworkanthropicgoogle-geminiopenaiultralyticsgenerative-process-automationcomputer-usegpt4oomniparser
  Language:Python 1418

• zai-org / CogAgent

  An open-sourced end-to-end VLM-based GUI Agent

  gui-agentcomputer-usevlmagentglm
  Language:Python 1081

• deedy / mac_computer_use

  A fork of Anthropic Computer Use that you can run on Mac computers to give Claude and other AI models autonomous access to your computer.

  aianthropicclaudecomputer-use
  Language:Python 825

• microsoft / WindowsAgentArena

  Windows Agent Arena (WAA) 🪟 is a scalable OS platform for testing and benchmarking of multi-modal AI agents.

  agenticaiai-agentai-researchwindowsai-benchmarkdesktop-agentcomputercomputer-use
  Language:Python 783

• instavm / clickclickclick

  A framework to enable autonomous android and computer use using any LLM (local or remote)

  android-automationcomputer-usegeminiollamaopenaiagentsai-agents-frameworkantrophicframeworkgenerative-aimolmopythonoperator
  Language:Python 512

• suitedaces / computer-agent

  Desktop app powered by Claude’s computer use capability to control your computer

  aiai-toolsanthropicclaude-3-5-sonnetcomputer-useguipyqtpyqt6python
  Language:Python 506

• baryhuang / mcp-remote-macos-use

  The only general AI agent that does NOT requires extra API key, giving you full control on your local and remote MacOs from Claude Desktop App

  computer-usemcp-servermacos-useclaude-desktopmacosgeneral-agent
  Language:Python 413

• OS-Agent-Survey / OS-Agent-Survey

  This is the repo for the paper "OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use" (ACL 2025 Oral).

  mllmssurveyagentllmsguigui-agentcomputer-usephone-usebrowser-agentweb-agentos-agentcomputing-devicesos-agent-surveycomputer-using-agentcomputer-usingoperator
  364

• BrowserOperator / browser-operator-core

  Browser Operator - The AI browser with built in Multi-Agent platform! Open source alternative to ChatGPT Atlas, Perplexity Comet, Dia and Microsoft CoPilot Edge Browser

  agent-workflowagentic-aiagentslanggraphllamacppllmmcpmcp-clientollamaopen-operatoropenaioperatorbrowser-operatorcomputer-useagent-browserai-browseragentic-browseragentic-frameworkagentic-workflow
  Language:TypeScript 317

• cyberdesk-hq / cyberdesk

  Open source virtual desktops for AI agents

  ai-agentscomputer-usefastapihonokubernetesnextjsterraformvirtual-machine
  Language:JavaScript 290
• open-computer-use

  LLmHub-dev / open-computer-use

  The Open Framework for autonomous virtual computer agents at scale, fully open-source, safe, auditable, and production-ready.

  agentic-frameworkaiai-agentsclaudecomputer-usecomputer-use-agentllmopenaicli-toolscomputer-controlfull-stackgui-automationllm-agentssaas-applicationgemini-apixaiagentanthropicgoogle-apigemini-ai
  Language:TypeScript 201

• cuga-project / cuga-agent

  CUGA is an open-source generalist agent for the enterprise, supporting complex task execution on web and APIs, OpenAPI/MCP integrations, composable architecture, reasoning modes, and policy-aware features.

  computer-useenterprisegeneralist-agentmcp
  Language:Python 182
• spongecake

  aditya-nadkarni / spongecake

  Spongecake is the easiest way to launch computer use agents.

  ai-agentsai-agents-frameworkautomationcomputer-usedockerllmopenaipython
  Language:JavaScript 159

• BIGPPWONG / EdgeBox

  A fully-featured, GUI-powered local LLM Agent sandbox with complete MCP protocol support. Features both CLI and full desktop environment, enabling AI agents to operate browsers, terminal, and other desktop applications just like humans. Based on E2B oss code.

  code-interpretercomputer-usee2bllm-agentllm-sandboxmcp
  Language:TypeScript 157

• bilalonur / awesome-llm-os

  A curated list of awesome resources, tools, research papers, and projects related to the concept of Large Language Model Operating Systems (LLM-OS).

  large-language-modelsllmllmosnatural-language-processingoperating-systemsllm-oslarge-language-modelawesomeawesome-listagentcomputer-use
  137

• 777genius / os-ai-computer-use

  AI controls your OS. OS AI Computer Use, OS and API agnostic. For now on Anthropic (Claude) API. Desktop app ready.

  agentaiai-agents-frameworkanthropicbrowser-useclaudecomputer-usecomputer-use-agentcomputer-visionmacosos-ai-cross-platform-engineeringpythonvisionwindowsartificial-intelligencecliflutterguidesktop-automation
  Language:Python 133

• chatsci / Aeiva

  A general AI agent framework that can be adapted to various tasks and environments.

  agentaiai4sciencecomputer-usellmmulti-agent-systemmultimodalself-evolving-systemslarge-languge-modelsmemoryworld-modelcomputer-usage
  Language:Python 102

• jeffrey-zang / opus

  On-device computer use agent that runs fully in the background 🪄

  computer-useelectronopusreacttailwindagenticmacos
  Language:TypeScript 93

• open-compass / MMBench-GUI

  Official repo of "MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents". It can be used to evaluate a GUI agent with a hierarchical manner across multiple platforms, including Windows, Linux, macOS, iOS, Android and Web.

  benchmark-frameworkcomputer-usegui-agentvision-language-model
  Language:Python 84

• openmule / gacua

  The World's First Out-of-the-Box Computer Use Agent Powered by Gemini-CLI @openmule

  agentaicomputer-usegacua
  Language:TypeScript 84

• TurixAI / TuriX-CUA

  This is the official website for TuriX Computer-use-Agent

  agentai-agentscomputer-use-agentcuacomputer-automationmcpcomputer-usebrowser-usegui-agentgui-operatorqwen3-vl
  Language:Python 74

• AB498 / computer-control-mcp

  MCP server that provides computer control capabilities, like mouse, keyboard, OCR, etc. using PyAutoGUI, RapidOCR, ONNXRuntime. Similar to 'computer-use' by Anthropic. With Zero External Dependencies.

  automationcomputer-usemcp
  Language:Python 68
• TongUI-agent

  TongUI-agent / TongUI-agent

  Release of code, datasets and model for our work TongUI: Building Generalized GUI Agents by Learning from Multimodal Web Tutorials

  computer-use-agentvision-language-modeltonguiagentcomputer-usegui-agentvision-language-actionvision-language-action-model
  Language:HTML 55

• lvqq / intelli-browser

  ✨ Use natural language to control your browser, powered by LLM and playwright

  claudeclaude-3-5-sonnete2ee2e-testsplaywrightanthropiccomputer-use
  Language:TypeScript 48

• presidio-oss / factif-ai

  AI-powered computer control for automated testing. Factifai uses vision models (Claude, GPT-4o, Gemini) to interact with applications naturally - clicking, typing, and verifying results just like a human would.

  automated-testingcomputer-usehaihuman-aiomniparseranthropicautomationbedrockclaudedocker-vncgpt-4opuppeteertestingfactifai
  Language:TypeScript 48

• reidbarber / webmarker

  Mark web pages for use with vision-language models

  promptprompt-engineeringsomvision-language-modelset-of-markclaudegeminigpt4ogpt4vllmsplaywrightqwen-vloperatorcomputer-usecomputer-using-agentcua
  Language:TypeScript 46