Meta Ray-Ban smart glasses integrate video communication, Apple Music and multimodal AI

Meta* announced that it has brought video calling, Apple Music and multimodal artificial intelligence features to Ray-Ban that can tell the user what the AI ​​assistant can see and hear through the glasses' camera and microphones.

About Ray-Ban smart glasses

Meta* Ray-Ban smart glasses were announced in September 2021. They were developed in partnership with EssilorLuxottica. Smart glasses combine stylish designer glasses with cutting-edge technology to allow users to enjoy a wide range of features and functionality.

Meta* Ray-Bans come with the following accessories and user manuals:

• charging case;
• USB-C charging cable
• quick user guide;
• Safety and Warranty Guide;
• instructions for ordering prescription lenses;
• cleaning cloth.

With this update, the glasses have a new cat-eye frame style. Meta* also presented the first limited edition of Ray-Ban smart glasses in an exclusive Scuderia Ferrari color.

About new features in Ray-Ban

Ray-Ban has introduced Meta* AI virtual assistant. With it, users can answer questions, create photorealistic images, and more. Now Meta* has expanded multimodal AI functions, introduced calls via WhatsApp* and Messenger*, and added the option to connect to Apple Music.

In an early presentation of the AI ​​features in Ray-Ban's Meta*, Mark Zuckerberg demonstrated how he asked smart glasses to match the pants to the shirt he was holding. The AI ​​described the shirt in detail and suggested several options for trousers that could complement the look. In addition, Zuckerberg asked the AI ​​assistant in Ray-Ban smart glasses to translate text and show several captions for images.

Additionally, Ray-Ban's Meta* AI also accurately described the illuminated wall sculpture in a video by Meta's CTO. Andrew Bosworth talked about some of the other features: photo captions, translation, and summarization. The latest video shows Zuckerberg making a WhatsApp video call through smart glasses.

How AI functions work

When users contact Meta* AI with questions about the content of what they see, the smart glasses automatically send photos to Meta* cloud storage for AI analysis. Once processed, Meta* AI provides an audio-visual response, allowing users to view queries, images, and text responses in Meta* AI.

All AI processed photos are saved and used to improve Meta* products and will also be used to train Meta* AI. Information will be collected, used and stored in accordance with the Privacy Policy.

Starting today, the updated smart glasses are going on sale. However, the multimodal AI assistant only works in the US and Canada.