Google has announced an upgrade to AI Mode on Google Search, which will now incorporate Gemini’s multimodal capabilities. This enhancement promises to expand the functionality of Search, allowing it to better handle comprehensive queries. The revamped AI Mode will be accessible to more “Labs” users across the United States. With the integration of Gemini and Google Lens, users can now take a photo or record a video and pose intricate questions related to what they see.
According to Google, this fusion of technology enables users to ask complex, exploratory questions, whether that involves comparing two products, seeking how-to guides, or planning trips. This change significantly bolsters the capabilities of AI Mode, as it utilizes Gemini’s advanced understanding of images. The new AI Mode can interpret various elements in an image, such as materials, colors, and shapes, and can consider arrangements of multiple objects. An example of this functionality is its ability to read book titles, discern themes among them, and recommend similarly high-rated books.
The system employs a “query fan-out” technique, generating multiple related queries about the image and its components, similar to traditional text-based searches. Currently, Google is in the process of testing this feature, having launched AI Mode last month. Early feedback from Google One AI Premium subscribers has been favorable, with users noting its efficacy in providing quick and detailed answers to complex inquiries. Google is also committed to continuously refining AI Mode based on feedback from its users in “Labs.”
Now available on both Android and iOS platforms via the Google app, AI Mode is exclusively accessible to Google One AI Premium subscribers.