Microsoft Launches “Hey, Copilot” Voice Trigger and Visual AI Context to Transform Windows 11 Assistant

Microsoft has begun rolling out a major upgrade to Copilot in Windows 11, enabling a voice trigger says “Hey, Copilot” and allowing questions based on what is shown on the screen. The update lets Copilot “see” the user’s screen, enabling tasks such as identifying where photos were taken, planning flights, or offering tailored budget suggestions.

A promotional video demonstrates Copilot highlighting relevant settings in Spotify to enable lossless audio, illustrating how the feature aims to move beyond simple web searching to practical, system-level assistance. Both Hey, Copilot and the visual context rely on cloud computing, raising privacy concerns, which Microsoft addresses by making Hey, Copilot opt-in and Copilot Actions optional with real-time review and manual control.

Copilot Actions now also supports local operations such as resizing photos within a folder, with tasks running in a sandboxed environment to keep Copilot confined to its assigned duties. The rollout will continue in phases, alongside plans for an Ask Copilot search integrated into the Windows 11 taskbar, with broader AI-driven workflow expansions.