Microsoft releases free Copilot Vision for screen interpretation

Microsoft has launched a free version of Copilot Vision, an AI assistant that interprets screen content to aid users with applications. Announced by Microsoft AI CEO Mustafa Suleyman, the tool is voice-activated, providing contextual assistance by analyzing screen displays. Copilot Vision guides users through tasks like recipe preparation or job application comprehension, offering relevant information. While it highlights screen areas and suggests information, it doesn't perform actions like clicking links. Extended features are exclusive to Copilot Pro users, integrating with software like Photoshop and video editors. The free version is accessible via Microsoft's website using the Edge browser, requiring permission to start a session through the Copilot sidebar.