Microsoft is introducing new AI capabilities to its Copilot chatbot, adding voice and vision functionalities aimed at providing intuitive design and seamless responses.
Copilot Voice allows hands-free conversations through four voice options, enabling users to brainstorm, ask quick questions, or engage in casual chats. However, it remains unclear if the voice output will be real-time or support emotional tones.
Copilot Vision enables the AI to see what the user sees on their screen, supporting verbal inquiries about displayed content, such as asking about the colors and materials of furniture in a shown image. This feature requires explicit user activation and currently operates with a limited number of websites, ensuring user privacy as data will not be collected for AI training.
Additionally, Microsoft's Recall feature, which captures passive screenshots and tracks local user activity, is expanding to a broader audience among Windows Insider users with Copilot + PCs this month. Initially available only on Snapdragon-based systems, it will also support AMD devices in the near future.