Meta Updates Smart Glasses with Real-Time AI Video

Ray-Ban Meta Smart Glasses Receive Significant AI Enhancements

Meta’s Ray-Ban Meta smart glasses are now benefiting from a suite of new, AI-driven features. These updates include the capability for continuous dialogue with Meta’s AI and real-time language translation.

Live AI and Conversational Capabilities

Owners of Ray-Ban Meta glasses participating in the early access program within the U.S. and Canada can now install firmware version 11. This update introduces “live AI” functionality.

This feature, initially revealed earlier in the autumn, allows users to engage in uninterrupted conversations with Meta AI. The system remembers previous discussion points, enabling contextual follow-up questions and topic shifts.

Importantly, the standard “Hey, Meta” activation phrase is not required for these ongoing interactions. Users can seamlessly interrupt the AI assistant as needed.

Real-Time Video Analysis with AI

Live AI extends its capabilities to real-time video processing. Wearers can pose questions about their surroundings as captured by the glasses’ camera. For instance, they can inquire about points of interest within their neighborhood.

The development of real-time AI video for Ray-Ban Meta was a central theme at Meta’s Connect developer conference this fall. It is presented as a competitive response to technologies like OpenAI’s Advanced Voice Mode with Vision and Google’s Project Astra.

This update positions Meta as a leading technology company in bringing real-time AI video to the smart glasses market. While Google has announced plans for similar AR glasses, a firm release date remains unspecified.

Future AI Suggestions

Meta anticipates that live AI will eventually proactively offer “useful suggestions” to users, even before a question is posed. The specific nature of these suggestions has not yet been detailed by the company.

Live Translation Feature

Firmware v11 also incorporates live translation functionality. This allows Ray-Ban Meta users to translate spoken language in real-time between English and Spanish, French, or Italian.

During conversations with speakers of these languages, users will hear the translated audio through the glasses’ open-ear speakers and simultaneously view a transcript on their connected smartphone.

Shazam Integration

Ray-Ban Meta now includes Shazam support with the latest firmware. Users can activate the feature by saying, “Hey, Meta, Shazam this song,” enabling the glasses to identify the currently playing music.

Ongoing Refinement and Accuracy

Meta acknowledges that the new features, particularly live AI and live translation, may not always be perfectly accurate. The company emphasizes its commitment to continuous improvement and refinement of the user experience.

Recent Updates and Sales Performance

Ray-Ban Meta received a previous significant update in November, with select AI capabilities being extended to users in France, Italy, and Spain. The glasses are experiencing strong sales, with EssilorLuxottica, the owner of Ray-Ban, reporting that Ray-Ban Meta was the best-selling glasses brand in 60% of Ray-Ban stores across Europe, the Middle East, and Africa as of October.