Google Lens now offers not only image search, but also video and voice search — just open the camera in the search box and dictate what you’re seeing at the time.
As of yesterday, the option is available in Search Labs on Android and iOS — but only in English.
Google first demonstrated video search at the I/O event in May: in an example, a video showed an aquarium and asked to explain why fish swim in groups, while Google Lens, using Gemini AI, quickly provided the answer.
Google’s Vice President of Engineering Rajan Patel in a comment The Verge explained that Google Lens considers video as a series of frames and uses similar computer vision methods as in the case of images (however, it additionally involves Gemini artificial intelligence, which analyzes the sequence of frames and available answers on the Internet).
Currently, individual sounds in the video are not identified (for example, Lens will not help you identify a bird by its singing), but Google says it has already experimented with the feature.
Meanwhile, voice queries in Google Lens have also been updated for image search — and now you can do it simultaneously with shooting, not after processing as before. The option has already been released to the public, but it is currently available only in English.
Spelling error report
The following text will be sent to our editors: