AI news, problem solutions & tool picks
DigestX

Tool Suggestions

Gemini can now drive your Mac — computer use in the Gemini app

· 3 min read

Photo via Pexels

Google's Gemini can now operate your Mac for you. Computer use, announced November 19 in the Gemini app for Mac, lets the assistant work through your apps, files and websites to finish multi-step tasks — clicking, typing and filling in forms — while you keep working on something else. It is US-only for now, needs a paid Google AI plan and an Apple Silicon Mac, and Google's own warnings about it are unusually blunt.

What it does

You describe what you need; Gemini handles the clicking, typing, menus and forms — "the repetitive work that normally takes dozens of clicks", in Google's words. It works inside an isolated background window with a live preview right in your chat, so "your main screen and cursor remain completely free, so you can keep typing, designing, or taking calls without interruption." You choose which apps Gemini can access, watch every step live, pause at any time, and approve key actions before they happen.

What it is for

Google's examples run from creative work to chores. It can batch color-grade photos in design software and set up complex 3D scenes — Google's hero example takes a child's butterfly sketch, models it and rigs it in Blender. It can extract weights, dimensions and addresses from local PDFs to fill out multi-box shipping quotes. It can pull metrics and screenshots from live dashboards across regions and build a presentation in Google Slides. And it can analyse clothing photos from a local folder, research pricing and stage resale listings.

Who gets it

Computer use is rolling out in English in the US, in the Gemini app for Mac, which you download at gemini.google/mac. Google gives no dates for any other country. You need an Apple Silicon Mac running macOS Sequoia 15.0 or later, 8 GB of RAM or more, 200 MB of free disk space and a stable connection; Intel Macs are not supported. A personal Google account, age 18 or older — work and school accounts are not included.

On plans, there is a discrepancy worth stating plainly. Google's announcement lists AI Plus, Pro and Ultra subscribers, but Google's own support documentation currently specifies only Pro and Ultra for controlling desktop apps. AI Pro is $19.99 a month in the US; Ultra starts at $99.99. No price is given here for AI Plus — published figures conflict.

The warnings, in Google's own terms

Google warns Gemini "can make mistakes, permanently delete Workspace or computer files, and send or share files with third parties." It creates temporary backups of files it works with, recoverable before you move to another task — but they are deleted when a new query starts or after 24 hours, and some changes cannot be undone. It can read multifactor authentication codes visible in desktop or messaging apps. Untrusted content in one app could redirect it into taking actions in another app it has permission to use — prompt injection, acknowledged by Google. Granting access to code editors or developer tools could enable shell command execution or broader filesystem changes. The permissions it needs are macOS Accessibility and Screen & System Audio Recording; it also asks before controlling individual apps.

Google does not say which Gemini model runs the feature, and publishes no benchmark or success rate — the capability is a claim, not a measured result.

The timing

Apple shipped new permission controls in the macOS 27.3 developer beta 2 on November 16 — three days before Google's announcement — requiring explicit approval before AI apps get Full Disk Access, after Apple's October warning that such access can expose files, messages, email and browsing history. The two moves land together: the Mac is getting AI agents that can click for you, and the operating system is adding the gates to contain them.