You can now ask about any screen to Gemini

Google’s Gemini AI is making strides in enhancing user experience with the introduction of two highly anticipated features: “Ask about this screen” and the ability to summarize YouTube videos.

These new functionalities are poised to seamlessly integrate into the Google ecosystem, offering users a more efficient and informative way to interact with their devices.

Ask about this screen is a feature that allows users to query Gemini about any information displayed on their screen. Whether it’s a document, webpage, or image, Gemini can provide summaries, answer questions, or offer insights based on the content. This feature is particularly useful for quickly extracting key information from complex or lengthy documents.

Yet, some people like umang on X did not really like it.

I opened a presentation in Google drive.

I didn’t realize I had Gemini open.

It gave a great summary of the content in bullet points.

This was my first experience with Gemini.

I then asked it to create images, but wasn’t impressed.

How has your experience been with…

— umang