Gemini’s desktop app can now understand your screen through voice control

TL;DR Gemini on Mac now supports hands-free voice commands, letting you press and hold the fn key to talk to the AI from any app without switching windows. Gemini can understand what’s on your screen to rewrite documents, polish emails, and summarize notes. Voice dictation is getting smarter too, automatically removing filler words like “umm” and “ahs” to turn spoken thoughts into clean, polished text.

The Gemini app on Mac has slowly been turning into much more than a chatbot, and Google’s latest update pushes it another step in that direction. Instead of constantly switching between typing and clicking, you’ll soon be able to get things done by simply talking. Google is introducing a new voice shortcut for the Gemini app on macOS.

Just press and hold the fn key on your Mac, start speaking, and Gemini will listen from whichever app you’re currently using.