AR glasses with multimodal AI nets funding from Pokémon Go creator
... Today, Singapore-based Brilliant Labs announced its new product, Frame, a pair of lightweight AR glasses powered by a multimodal AI assistant called Noa. The glasses have captured the attention and investment of John Hanke, CEO of Niantic, theaugmented reality platform behind games like Pokemon Go. ...
In a video demo seen by TechCrunch, one of Brilliant Labs’ founders asked Noa through voice for a self-introduction. After about three seconds, the agent generated and projected an answer in text onto the lenses.
In addition to voice commands, Noa is capable of visual processing, image generation and translation, thanks to the handful of AI models it has integrated: conversational search engine Perplexity AI; Stability AI’s text-to-image model Stable Diffusion; OpenAI’s latest text generation model GPT4; and the speech recognition system Whisper. Frame’s lenses have a resolution of 640 x 400 for displaying videos and photos. ...
Brilliant Labs’ Bluetooth-enabled devices rely on a smartphone to access the various AI models today. Eventually, though, the founders want to do away with the phone host and embed lightweight machine-learning models directly into the glasses. ...
Frame will be available for pre-order starting today and will retail at $349, the same as Monocle’s price tag. The devices will begin shipping in April. ...
See the full story here: https://techcrunch.com/2024/02/08/ar-glasses-with-multimodal-ai-attracts-funding-from-pokemon-go-founder
