Meta has announced a major AI update coming soon to its Meta Quest platform, home to some of the best VR headsets you can buy. In the coming weeks, you’ll be able to access your smart voice assistant whenever you’re wearing your Quest 3, Quest Pro, or Quest 2.
In the video below you can see some examples of Meta AI in action on Quest 3. Meta AI can see real-world objects and answer questions using the mixed reality mode on Quest 3 and Quest Pro. The black and white pass-through camera on Quest 2 is not supported for visual input.
Flash Deal
Get Microsoft Office for Windows/Mac for $25
$229 Save $204
Lifetime access to Word, Excel, PowerPoint, Outlook, OneNote, Publisher, and Access.
$229 Save $204
Meta Quest VR headsets in the US and Canada are expected to get the new multimodal AI features as soon as August, though it’s being rolled out in stages so you might not see the update until September.
I asked Meta about generating an AI image in the Quest headset, and whether the AI could see my Meta avatar and the virtual environment. These features may come at a later date, but not in the next update.
Meta AI has been rolling out to Facebook, Messenger and WhatsApp since September 2023, supporting users with customized AI for cooking, jokes and games. You can also generate images by using the @MetaAI /imagine command while chatting with friends.
Meta AI also powers Ray-Ban Meta Smart Glasses, providing a cutting-edge AI assistant wherever you are. The upcoming Meta Quest update will bring a similar version of AI available in Meta Smart Glasses. You can ask general questions like what to wear in the typically hot weather of Palm Springs, or even hold up a pair of shorts to have Meta’s AI suggest matching tops.
This announcement comes at the same time that Meta unveiled Llama 3.1 with 405B parameters, the largest AI release ever made as open source. Meta also published AI benchmarks showing that Llama 3.1 can compete with the latest OpenAI and Anthropic models.
You can try Meta AI 3.1 right now on meta.ai and on WhatsApp in the U.S. Make sure your Meta Quest VR headset is plugged in and in sleep mode so you can get the update as soon as it’s available in your region.