Google has announced a bunch of new Google Lens and AR tools to assist users in learning and shopping, as part of its SearchOn event.
To provide greater assistance with learning, the Google Lens has been updated to now recognize up to 15 billion things including plants, animals, landmarks, etc. Moreover, it can translate more than 100 languages and pronounce words and sentences out loud.
Lens can also be used to help parents assist their children in solving homework problems. It provides step-by-step guidance, including videos that help with learning and understanding of concepts from different subjects like math, chemistry, physics, biology, etc.
The AR functionality is helpful for hands-on learning, as it allows exploring concepts up close, such as visualizing the inner workings of a plant cell or viewing the elements of the periodic table in 3D.
Google Lens also facilitates shopping with its ability to find products via a photo or screenshot. Now, Lens can also look for exact or similar items for a selected shopping product and also suggest ways to style it. The product image can be selected on the Google app or Chrome on Android.
The technology that Lens uses for this functionality is the Style Engine Technology that combines the world’s largest database of products with millions of style images. It then ‘'pattern matches’' to understand different clothing ideas like “ruffle sleeves” or “vintage denim” and how they pair with different apparel.
Furthermore, Google has updated its AR technology to now show users AR models of cars. These models will exhibit colors and intricate details like dashboard buttons of a variety of cars that a user wishes to explore. The models can even be viewed against breathtaking backdrops and even in the user’s driveway.
Google has worked with top auto brands like Porsche and Volvo to bring users this exciting AR feature, and is currently experimenting with it in the U.S.