Ray-Ban Meta Glasses Get Major AI-Powered Upgrades with Firmware v11
Meta’s Ray-Ban Meta smart glasses are getting a significant boost with the rollout of firmware v11, introducing several new AI-powered features designed to enhance the user experience. The new capabilities include live AI conversations, real-time video analysis, live translation, and Shazam support, making the smart glasses more versatile than ever.
Live AI Conversations and Real-Time Video Interaction
One of the standout updates in firmware v11 is the introduction of “live AI.” This feature allows Ray-Ban Meta owners to engage in ongoing conversations with Meta’s AI assistant, Meta AI, without needing to use the “Hey, Meta” wakeword. Users can interrupt the AI for follow-up questions or change topics seamlessly, allowing for a more natural, fluid conversation.
The live AI also extends to real-time video, enabling wearers to ask questions about what they’re seeing in front of them. For example, they could inquire about objects, landmarks, or even neighborhoods they’re passing through, and Meta AI will provide information based on what the glasses’ front-facing camera detects.
Meta’s Connect developer conference earlier this fall highlighted this capability, positioning it as a competitor to similar offerings from OpenAI and Google. With this update, Meta becomes one of the first major tech companies to deliver real-time AI video on smart glasses, a step forward in augmented reality (AR) applications.
Live Translation and Shazam Integration
Firmware v11 also introduces live translation for English, Spanish, French, and Italian. This feature allows users to translate spoken language in real-time. For example, if a wearer is conversing with someone speaking Spanish or Italian, they’ll hear the translation in English through the glasses’ open-ear speakers and can view a transcript on their paired smartphone.
Additionally, Shazam support is now available. Users can activate Shazam by saying, “Hey, Meta, Shazam this song,” to identify music playing in the environment, adding a fun and practical feature to the glasses.
A Step Forward in Smart Glasses Technology
The latest update brings Ray-Ban Meta smart glasses closer to a fully integrated AI assistant, blending real-time video capabilities and natural language processing. Meta acknowledges that the new features, particularly live AI and translation, may still require fine-tuning, promising continued improvements in future updates.
Ray-Ban Meta glasses have been a commercial success, with Meta’s hardware partner EssilorLuxottica reporting that they were the top-selling glasses brand in 60% of Ray-Ban stores across Europe, the Middle East, and Africa as of October. With firmware v11’s launch, Meta aims to further solidify the glasses as a leading product in the wearable tech market.
Source: https://thesperks.com/cohere-partners-with-palantir-powering-ai-for-enterprise-customers/
Source: https://techcrunch.com/2024/12/16/meta-updates-its-smart-glasses-with-real-time-ai-video/
