Agents tagged "gui-automation"

13 results
gui-automation ×
Automation & Ops

OpenAdapt

Compile demonstrated GUI work into deterministic local programs with evidence-backed outcomes.

★ 1.8k FS 86 Good 25d ago MIT
Automation & Ops

Clawd Cursor

Compiles the screen into one addressable UI map so any AI agent can safely drive the real desktop — local, cross-platform, model-agnostic, with every action verified.

★ 403 FS 74 Some gaps today MIT
Automation & Ops

macOS Harness

A minimal harness that hands an LLM the whole Mac through six primitives — no app-specific tools, no framework, no rails.

★ 904 FS 55 Major gaps 1mo ago MIT
Dev & Engineering

OSWorld 2.1 Computer-Use Agent Benchmark

Run long-horizon desktop tasks on real Ubuntu VMs and score computer-use agents reproducibly.

★ 359 FS 53 Major gaps 12d ago Apache-2.0
Automation & Ops ✓ Microsoft · Official

UFO³ Galaxy

Coordinates Windows, Linux, and Android task workflows through adaptive DAG-based orchestration.

★ 10k FS 51 Major gaps 10d ago MIT
Automation & Ops

OpenGUI Mobile Operator

An Android GUI framework that lets AI inspect screens, plan steps, and operate real mobile apps.

★ 1.8k FS 45 Major gaps today NOASSERTION
Automation & Ops

Open Computer Use (MCP desktop service)

An MCP service for running desktop Computer Use operations from AI clients.

★ 2.4k FS 44 Major gaps today MIT
Automation & Ops

CogAgent GUI Operator

A screenshot-driven VLM that produces grounded GUI actions from natural-language tasks.

★ 1.2k FS 42 Major gaps 1y ago Apache-2.0
Productivity & Collaboration

Agent S

A GUI automation framework that turns screenshots and model decisions into computer actions.

★ 13k FS 41 Major gaps 1d ago Apache-2.0
Data & Analysis

OSWorld

Benchmark multimodal computer-use agents on open-ended tasks in real desktop environments.

★ 3.2k FS 33 Major gaps 25d ago Apache-2.0
Productivity & Collaboration

TARS Multimodal Operator

Use natural-language and vision-driven automation across computers, browsers, and MCP-connected tools.

★ 39k FS 30 Major gaps today Apache-2.0
Automation & Ops

Mobile-Agent: A Family of Powerful GUI Agents

A multi-platform GUI agent family by Alibaba's Tongyi Lab, automating mobile, desktop, and web tasks via multimodal models.

★ 9.3k FS 29 Major gaps 3mo ago MIT
Dev & Engineering

CRAB Cross-Environment Benchmark

A Python-centric framework for building and evaluating multimodal language-model agent environments.

★ 428 FS 28 Major gaps 4d ago