The Ray-Ban Meta smart glasses have become even more advanced with the introduction of an innovative feature called live image description. This feature uses the glasses’ built-in camera to analyze the user’s surroundings and provide information about objects or scenes in real-time, with the help of an onboard AI assistant. By simply saying “Hey Meta” to activate the assistant and asking a question, users can get instant answers to their queries.
One of the most exciting applications of this technology is its ability to translate foreign languages. For instance, when visiting a new city and encountering a sign in an unfamiliar language, users can ask their glasses to translate the text for them, without the need for a phone or a phrasebook. The glasses can also identify a wide range of objects in the user’s environment, from landmarks and dog breeds to flowers and cars, and provide relevant information about them.
What sets this technology apart is its use of “multimodal” AI, which means that it can process both visual information and voice commands. This allows for a more interactive and immersive experience, as users can ask questions about what they see and get accurate and detailed responses.
Moreover, the live image description feature goes beyond basic object recognition and can provide users with contextual information about what they are seeing. For example, when visiting a museum and looking at a painting, users can ask their glasses to provide information about the artist, the painting’s history, or the artistic movement it belongs to. This feature opens up a whole new world of on-the-go learning and exploration.
The live image description feature can also be customized to suit the user’s interests and needs. For instance, birdwatchers can use the feature to identify different bird species and get information about their behaviours and habitats. This personalized assistance can turn everyday activities into enriching learning experiences.
It is worth noting that these features are currently in beta testing and are gradually rolling out to users. To access the live image description feature, users need to ensure that their Ray-Ban Meta glasses are updated to the latest software version. The video call-sharing feature is also being rolled out, and Ray-Ban Meta glasses are now available in 15 countries, with a range of frame options to choose from.
