Google has begun rolling out new features for Gemini Live, powered by Project Astra, enabling real-time screen and camera analysis. This allows Gemini Live to view your phone's screen and provide instant answers based on the content. A user discovered a "Share screen with Live" button within the Gemini overlay on a Xiaomi device. The feature also grants access to real-time camera capabilities, allowing Gemini to analyze live footage and provide contextual responses.
These features are part of the Google One AI Premium plan for Gemini Advanced subscribers on Android, with Pixel and Galaxy S25 users among the first to experience them.
Project Astra, led by Google Deepmind's Demis Hassabis, aims to create a multimodal AI assistant capable of processing audio, video, images, and text in real-time.