Microsoft's AI assistant, Copilot, has received a significant update, introducing voice control and real-time screen visibility.
The enhancements bring Copilot closer to competing AI chatbots like Google Gemini and OpenAI's ChatGPT. Notably, the new Copilot Voice feature allows users to engage in spoken conversations with the chatbot, similar to Gemini Live and ChatGPT's expanded voice mode. Developers have introduced four voice options for the chatbot, which has been described as pleasant, with natural pauses and minor errors.
Another major addition is the Vision tool, enabling Copilot to process text and images on the user's screen in real-time, providing answers or next steps without interrupting the workflow.
Microsoft emphasizes its commitment to privacy and security, stating that sessions involving screen sharing with Copilot are voluntary and data will be deleted after completion.
Additionally, the new Think Deeper feature allows Copilot to tackle complex questions and provide detailed, step-by-step responses, ideal for making difficult everyday decisions. This feature is currently in the experimental stage at Copilot Labs, and Microsoft is seeking user feedback to refine it.
The updated Copilot is now available for iOS and Android users, as well as on the web and Windows applications.