• Source:JND
Add as a preferred

Google I/O Updates: Google CEO Sundar Pichai unveiled a range of AI features for Google apps at the Google I/O event today. Among these was the 'Ask Photos' feature in Google Photos powered by Gemini. The search king also announced new Gemini AI features in Gmail, AI-enhanced Google Search and more. Here are the top announcements showcased for Google apps to know.

Ask Photos in Google Photos: The experiment can help users find or recall a specific media from their gallery and will be rolling out in the upcoming months. With the feature, users can frame their queries in a "natural way" to get the desired results. Plus, it can pull out the details from photos, suggest the best pictures and write captions using Gemini's multimodal capabilities.

Also Read: Google I/O 2024: Gemini 1.5 Flash Announced At AI-Packed Event, Gemini 1.5 Pro Gets 'Quality Improvements' | Details Inside

Gemini 1.5 Pro-Powered Side Panel: The side panel that houses Gemini in Gmail, Drive, Docs, Slides, and Sheets will now use Gemini 1.5 Pro. With a longer context window and improved reasoning, it can answer a wider array of questions. Plus, it can offer summarisation, suggest prompts and more. The side panel is currently available for Workspace Labs and Gemini for Workspace Alpha users.

Gemini AI In Gmail Mobile App: The company introduced three features for the app of its mail service. The first will allow 'summarisation' of mail threads in the app. Secondly, 'Contextual Smart Reply' will suggest more "detailed and nuanced" responses. Lastly, 'Gemini Q&A' will allow users to ask Gemini queries about the contents in the inbox or choose from the suggested prompts. These features will be available to select Workspace users in the upcoming months.

AI-Powered Overviews, Planning and Organisation In Search: The company showcased 'AI Overviews' that can return a "quick overview of a topic and links". It will roll out to users in the US and expand to more countries soon. Google also introduced meal and trip planning capabilities in Search (via Search Labs in the US) for creating plans as a starting point for an activity. Moreover, the company also announced 'AI-organised results' for generative AI-optimised search results page in the US.

Visual Search With Video: The company introduced the ability to allow people to ask questions using video to Google's Visual Search. "Searching with video will be available soon for Search Labs users in English in the US, and we'll expand to more regions over time," the company said.

Also Read: Google I/O 2024 Android: Enhanced Circle To Search To Multimodal Gemini Nano, Google AI Set To Revamp Android Experience 

AI Agents (Bonus): Google CEO Sundar Pichai highlighted the use cases of AI Agents in shopping to shop for shoes and later return them. However, the discussions around the feature in the "early days". Google boss Pichai describes AI Agents as "intelligent systems that show reasoning, planning, and memory" and can "think...and work across software and systems."