Microsoft Copilot Vision now scans entire computer screens

Microsoft is expanding Copilot Vision’s capabilities to scan entire computer screens, not just individual apps. The AI tool can now analyze everything on a user’s desktop or any specific browser or app window, representing a significant upgrade from its previous limitation of viewing only two apps simultaneously.

What you should know: Copilot Vision now provides comprehensive desktop analysis through an opt-in screen sharing approach.

• Users can activate the feature by clicking the glasses icon in the Copilot app and selecting which desktop they want the AI to analyze.
• The tool can “help analyze content, provide insights, and answer your questions, coaching you through it aloud,” according to Microsoft.
• Unlike Recall, which automatically captures regular screen snapshots, Copilot Vision requires manual activation similar to screen sharing during video calls.

How it works: The expanded functionality transforms Copilot Vision from a limited dual-app viewer into a comprehensive desktop assistant.

• Microsoft suggests use cases include “tips on making improvements to your creative project, help with improving your resume, or guidance while navigating a new game.”
• The feature builds on Microsoft’s initial testing that began last year, when Copilot Vision could only see web content in Edge browsers.
• The tool also maintains its ability to answer questions about what it sees through mobile phone cameras.

The big picture: This update positions Copilot Vision as a more versatile AI assistant that can provide contextual help across entire workflows rather than isolated applications.

• The expansion reflects Microsoft’s broader strategy of integrating AI assistance throughout the Windows experience.
• By requiring user activation rather than automatic monitoring, Microsoft appears to be addressing privacy concerns that have surrounded similar screen-scanning technologies.
• The rollout to Windows Insiders suggests Microsoft is taking a cautious approach to testing before wider deployment.