Google I/O 2024: New AI Assistant Can Read Everything Through Your Phone’s Camera

s aadeetya s aadeetya | 05-15 16:02

Google I/O 2024 keynote was surprise, surprise, all about AI. The company has a lot of catching up to do with OpenAI now taking ChatGPT to the 4o version earlier this week. The I/O 2024 keynote has shown us the work Google has been doing behind the scenes with the help of the Google Deepmind AI team.

And one of the products to roll out from the lab is called Project Astra, which is a new-gen AI assistant that promises to integrate AI into mobile devices with spatial understanding and video processing to give you accurate information.

Project Astra – The Everyday AI Assistant

The multimodal from Google is based on Gemini is basically its way of saying to OpenAI that we are here for the battle. So, how does this version of the AI Assistant work? Google is using the camera on your phone to guide the AI assistant to help you understand the things near you. Here’s a quick demo that Google showed at the keynote:

For a long time, we’ve been working towards a universal AI agent that can be truly helpful in everyday life. Today at #GoogleIO we showed off our latest progress towards this: Project Astra. Here’s a video of our prototype, captured in real time. pic.twitter.com/TSGDJZVslg— Demis Hassabis (@demishassabis) May 14, 2024

It can even read a code written on a PC and help you determine its purpose or solve the complex code as well. That’s not all, you can point the camera to the street and ask the AI assistant to tell you where you are located and get more localised details if indeed.

Google says these capabilities via Project Astra will be available in Gemini Live within the main app that will be available later this year. The tech will initially work on the Pixel phones and Google sees the AI assistant coming to more devices, which includes the smart glasses and even TWS earbuds some day.

About the Author
S Aadeetya
S Aadeetya, Special Correspondent at News18 Tech, accidentally got into journalism 10 years ago, and since then, has been part of established media ho...Read More

Disclaimer: The copyright of this article belongs to the original author. Reposting this article is solely for the purpose of information dissemination and does not constitute any investment advice. If there is any infringement, please contact us immediately. We will make corrections or deletions as necessary. Thank you.


ALSO READ

Sky-high shopping: South Korea unveils ‘flying cart’ drone for transporting goods over any terrain

SEOUL, Oct 23 — South Korean researchers have developed a transport drone flying on multiple flexibl...

tech | 12 minutes ago

Africa’s best-kept secret: Mozambique rolls out 100pc homegrown premium cigars for the global market

MAPUTO (Mozambique), Oct 23 — In a small neon-lit factory in Maputo, a dozen workers are hand-rollin...

life | 13 minutes ago

In South Africa, dry taps are the new reality as water crisis deepens

JOHANNESBURG, Oct 23 — Joyce Lakela runs a nursery in Tembisa, a Johannesburg township, but these da...

world | 13 minutes ago

From horror to hope: Rwanda’s genocide survivors rebuild lives 30 years on

PARIS, Oct 23 — Jeanne Allaire Kayigirwa was sure she was going to die three times during the Rwanda...

world | 13 minutes ago

Hyundai Motor India lists with record IPO, commits to Indian market with new tech and EV plans

As part of its effort to introduce clean mobility solutions for Indian buyers, Hyundai will launch f...

auto | 8 hours ago

Skoda Auto Volkswagen India plants over 7 lakh trees in Maharashtra for ecological restoration

Additionally, SAVWIPL has installed 18.5 MWp of rooftop solar power at its Chakan facility, which of...

auto | 8 hours ago