Skip to content

Open Computer Use

by iFuryStConnectorGet organised

Lets your AI agent see and operate the apps on your computer by clicking and typing

View on GitHub

About Open Computer Use

An open-source connector that lets an AI agent operate desktop apps on macOS, Linux and Windows. It reads each app's window, then clicks and types for the agent. Works with Codex, Claude Code and Gemini CLI.

For People using AI agentsMac, Windows and Linux users

Made by iFurySt

An open-source project published on GitHub by iFurySt. Its README says it was inspired by OpenAI's Codex Computer Use.

Stars
★ 2.8k
License
MIT
Cost
Free
Level
Intermediate
Runs
Local

Screenshots

From the project's own repository.

The Locked Use shield on a Mac: Open Computer Use is Using Your Mac
Image: iFurySt (MIT). Original file

Overview

Open Computer Use is an open-source MCP server that gives an AI agent control of desktop apps on macOS, Linux and Windows. It reads each app's interface through accessibility data and screenshots, then clicks, types and presses keys for the agent. You install it with npm, grant permissions on a Mac, and run one command to add it to Codex, Claude Code, Gemini CLI or opencode. It suits people who want an agent to finish tasks in apps that have no API.

It brings the desktop-control approach of OpenAI's Codex Computer Use to any MCP client, as open source.

Try these first

Start with the first one: it is a small task you can check easily.

  1. List the apps you can see and describe what is in the TextEdit window. Don't click or type anything.First try · read-only

  2. Open TextEdit, start a new document and type a shopping list: [items].types in an app

  3. In [app], find the setting for [option] and tell me where it is before changing it.

Example prompts written by Agent Flows Hub.

Capabilities

From the creator's documentation.

ToolsetWhat your agent can doAccess
App listLists the apps that are open on your computerYour computer
App stateReads an app's interface elements and takes screenshotsYour computer
Clicks and typingClicks, types and presses keys in the app you nameYour computer
Agent setupOne command adds it to Codex, Claude Code, Gemini CLI or opencodeYour config files
Locked UseOptional on Mac: keeps working while the screen is locked, behind a full-screen shieldSystem settings

Good to know

Hand an agent a task inside a desktop app, such as typing a note in TextEdit. It lists the open apps, reads the window's interface and then clicks and types step by step.

Limits

  • The agent acts with your mouse and keyboard in real apps, so a mistake can change or send things. Start in an app with nothing important open.
  • Locked Use is an opt-in Mac feature that installs system components and changes lock-screen authorization; leave it off unless you need it.

Notes by (original project name: open-computer-use), written from the creator's documentation, not from running it ourselves. Open Computer Use README · Locked Use guide

Stuck setting it up?

Tell us what happened. We take a look first; if it needs paid work, you get an estimate before anything starts.

Get help

Other connectors

  • Pascal Editor Lets your AI agent draw rooms, walls and furniture in a 3D home model you can then edit
  • PayPal MCP Lets your AI assistant create and send PayPal invoices, look up orders and review disputes
  • Pipeboard Meta Ads MCP Lets your AI assistant check, create and adjust your Facebook and Instagram ad campaigns
  • Playwright MCP Lets your AI agent open web pages, click, type and fill in forms in a real browser
  • Slack MCP Server Lets your AI assistant search your Slack, read threads and send or schedule messages
  • Stripe MCP Lets your AI agent look up payments and customers and create invoices in Stripe

See all 52 connectors · An MCP server is missing or disconnected

GitHub