Google Expands AI Mode with Image Query Capabilities

Google has expanded its AI Mode feature in Google Search to include the ability to ask complex questions about images, building on its recent launch. This new functionality leverages Google Lens' multimodal capabilities, enabling users to inquire about photos they have uploaded or taken with their camera.

AI Mode can analyze an entire scene in an image, understanding the relationships between objects, their materials, colors, shapes, and arrangements. Using a technique called 'query fan-out,' AI Mode generates multiple questions about the image and its components, offering more detailed insights than a standard Google search.

For instance, users can photograph their bookshelf and ask, "If I enjoyed these, what are some similar books that are highly rated?" AI Mode will identify each book and suggest similar titles, complete with links for further exploration or purchase. Users can also refine their search with follow-up questions, such as "I'm looking for a quick read, which one of these recommendations is the shortest?"

Google announced that AI Mode is now accessible to millions more users enrolled in Labs, its platform for experimental features, expanding beyond the initial availability to Google One AI Premium subscribers.