Hearing an AI speak in a pleasant tone while suggesting I tidy my workspace is a bit unsettling. I take pride in my setup, but maybe it’s time to organize the scattered gadgets and untangle the wires.
My sister would agree with that sentiment. However, the real surprise comes when an AI “sees” my messy desk and offers cleaning tips. Google’s Gemini AI chatbot can now do just that—and much more.
Introducing Project Astra
The key to this new capability is a feature update called Project Astra. After years of progress,it began rolling out earlier this month. The goal is to create an all-knowing and highly intelligent AI for your smartphone.
Google markets thes features under the name Gemini Live with camera and screen sharing. Developed by DeepMind, it was initially envisioned as a universal assistant, though its final name lacks excitement.
Accessing Gemini Live
This new functionality is available for Pixel 9 and Galaxy S25 users. If you have any Android phone along with a gemini Advanced subscription—costing $20 per month—you can use this toolkit too.
I tested it on both mentioned phones and also set it up on my OnePlus 13 without any hassle. To access Gemini Live, simply press the power/volume button or swipe from a corner of your screen; you can use it over any app as an overlay throughout your device.
Understanding Your Surroundings
I pointed my camera at a painting and asked about its style. Gemini Live quickly identified it as Madhubani art, explaining its vibrant colors and animal depictions accurately.
The AI than provided me with interesting historical details about Madhubani art's evolution over time. If voice interaction isn’t suitable for your environment, you can opt for text-based interaction rather.
I appreciate how concise Gemini Live's responses are; they encourage follow-up questions rather then overwhelming users with lengthy answers. It performs well across various topics but does have some limitations.
A Knowledge Resource
I challenged Gemini by showing it academic material—a book on Machine Learning—and was impressed when it recognized the title instantly while summarizing its main ideas effectively.
As I flipped through pages to check chapter titles, the AI paused to ask if I wanted information on any specific chapter—a surprising touch!
I requested explanations of complex concepts within those chapters, which were delivered clearly using information from beyond just what was printed in front of me.
For instance, when asking about Bhisham Sahni’s novel tamas’ introduction page details like award mentions were spot-on along with additional context not found there originally.
A Few Shortcomings
The Hindi language output from Gemini Live left much to be desired; pronunciation issues made comprehension difficult at times despite better performance in Urdu or Arabic contexts where errors still occurred occasionally.
Succeeding in Unexpected Areas
This AI excels at problem-solving tasks too! When tested against physics equations involving thermodynamics or statistics written down manually—it performed admirably well!
succeeding in Unexpected Areas
< P >This A.I excels at problem-solving tasks too! When tested against physics equations involving thermodynamics or statistics written down manually—it performed admirably well!< P >My sister who designs clothes showed one sketch through her camera view asking for feedback & suggestions—gemini praised her design before comparing styles seen elsewhere offering helpful advice regarding tools needed turning sketches digital alongside resources available learning them further!< H4 >A Few Familiar Pitfalls < P >Overall impressions indicate Project Astra makeover impressively showcases future smartphone capabilities ahead—but improvements remain necessary especially concerning memory accuracy during conversations where misidentifications occurred frequently leading confusion later down line.< / p >In conclusion: While there are notable flaws present today—Gemini live represents notable advancements made within generative A.I technology thus far providing practical applications worth exploring further moving forward towards achieving ideal companion status someday soon!
