Earlier this year, Google announced a new "AI Mode" for search results. This technology uses a "query fan-out" approach to run concurrent queries regarding your search item and its related topics and sub-topics. The results are then combined in one cohesive answer, which makes it a decent option for search queries that require comprehensive analysis and research. Over the past few months, Google has been adding new capabilities to AI Mode on a fairly frequent basis, and now, it has revealed new functionalities just in time for the back-to-school season.
For starters, the ability to ask complex questions about images is landing this week on desktop browsers - it was previously limited to Android and iOS. Google is sweetening the deal even further by enabling users to upload PDF files from desktop and asking questions about it. AI Mode will cross-reference your PDF with web search results and provide you detailed responses. This capability is scheduled for rollout in the coming weeks, after which Google will also work on adding support for more file types.
AI Mode is also adding a utility called Canvas. This is where you can leverage AI to plan your activities and organize information in a dynamic side-panel. This Canvas UI can also be used in tandem with file uploads to make use of a broader context window. Users in the U.S. should begin seeing the Create Canvas button on desktop browsers in the coming weeks.
Another feature coming this week is Search Live, which is based on Project Astra and is integrated with Google Lens. This enables an interesting use-case where you can open Google Lens and begin streaming your live feed to AI Mode in Google Search. The model will see exactly what you see which, again, provides more context and yields better answers.
Yet another integration of Lens in Search also allows the AI to see what you are seeing in your browser. The model will then provide you tips about topics open on your screen with customers also having the ability to "Dive deeper" through a dedicated button. This feature is also coming "soon"; it"s clear that Google is emphatic on making AI Mode in Search a core part of your daily routine.