Today, Microsoft is launching a new feature for the Copilot app on Windows 10 and 11. Dubbed "Copilot Vision with Highlights," it enables AI to see what is happening on the screen and offer you additional information, context, and analysis in real time. Microsoft says this feature acts as a "second set of eyes."
Copilot Vision on Windows works with two apps at once, allowing you to continue the workflow from one app to another. Also, the Highlights feature lets you ask the AI to guide you and explain how to do certain things within an app. For example, you can ask it how to trim a video in Clipchamp or how to remove an object in the Photos app.
You can invoke Copilot Vision by launching the Copilot app and clicking the glasses icon in the bottom-right corner of the composer. Next, select the app you want to share with Copilot and click "Share." After that, you can talk to Copilot and ask for suggestions, tips, additional information, and more. To stop sharing, click "Stop." Note that Copilot Vision with Highlights does not require a Copilot Pro subscription.
Microsoft adds that Copilot Vision with Highlights is a strictly opt-in experience, which means it never turns on without your command. After the initial Recall fiasco in 2024, Microsoft is taking a more cautious approach to new features in Windows 11, especially privacy-sensitive ones.
Copilot Vision with Highlights is currently rolling out to Windows 10 and 11 users in the United States. Microsoft says that users in other non-European countries will soon have access to the feature. Microsoft has been testing Copilot Vision among Windows Insiders for a couple of weeks. Now, it is ready for its prime time. You can read more about the feature in a blog post on the official Microsoft website.
23 Comments - Add comment