Google Lens now works with movies, and it’s tremendous spectacular

Google simply confirmed off a brand new Google Lens video search characteristic at Google I/O 2024. With it, you are able to do a Google search simply by recording a video along with your telephone.

In the demo on stage with Rose Yao, she is troubleshooting some points she’s having with a report participant she lately purchased. She doesn’t know what make or mannequin it’s, and the needle gained’t keep on the report when it’s taking part in. She is making an attempt to troubleshoot the problem with it however has no thought the place to start out. With the brand new Google Lens video search, simply taking a brief video and importing it means that you can seek for a solution.

Previously, Google Lens solely captured nonetheless pictures, however now you may ask your query utilizing video and audio. The Google Lens video search makes use of multimodal enter, which is an enormous focus for Google Search proper now. Once the video is uploaded, it’s damaged down body by body.

So, within the report participant downside instance, Google Search was in a position to determine the precise report participant in query after which combed by way of the web to search out related info on how you can repair the problem of the needle not staying. This info then goes into the AI Overview and offers step-by-step troubleshooting suggestions.

Google additionally confirmed off Google Astra, which is a generative AI with imaginative and prescient, textual content, and speech capabilities that makes use of your smartphone digicam to make sense of the world round you. Google AI overviews will likely be rolling out to everybody within the U.S. beginning right now.

Editors’ Recommendations