The XR Weekly Update (Nov 19, 2024): Meta Unveils Project Aria Research Kits, Surge of Chinese Smartglasses, and More!

Greetings from Finland! As I travel between the vibrant city of Helsinki and the enchanting landscapes of Lapland, I’ve been immersing myself in everything this amazing country has to offer. From meeting Santa Claus and petting reindeers to indulging in delicious local cuisine, it’s been quite an adventure. Pretty soon, I’ll be diving into the exciting world of MatchXR, one of Northern Europe’s leading XR events, and I’ll be sure to share more on that soon.

But before we dive into the week’s headlines, I want to dedicate this newsletter to Daniel Dyboski-Bryant, who recently passed away. I had the privilege of meeting him a few times, both in person at AWE US and in virtual spaces via ENGAGE. Daniel was a genuinely kind soul with a passionate drive to harness VR for educational purposes and to better humanity. His legacy will undoubtedly live on through the countless lives he touched and inspired.

Top News of the Week

Meta opens applications for Project Aria research kits

A couple of years back, Meta showcased Project Aria, designed as a precursor to the company’s future AR glasses. These glasses didn’t come with a display but were packed with sensors to capture data from a user’s point of view—a critical step for training AI systems for upcoming AR glasses. Initially, these were exclusive to Meta’s internal team and close partners, but there’s been a game-changing update. Meta is now inviting research centers from universities or corporations to apply for Project Aria Research Kits via their dedicated webpage. Chosen applicants won’t just get the glasses but a complete development ecosystem, including the SDK and cloud services that offer functionalities like environment reconstruction and video data obfuscation. It’s a remarkable chance for pioneering research in AR, backed by inspiring case studies from institutions like the University of Bristol and Carnegie Mellon University. Researchers should definitely consider exploring this opportunity.

Other Relevant News

New wave of smartglasses emerging from China and beyond

It’s been another dynamic week in the smartglasses arena. The buzz surrounding Ray-Ban Meta has sparked a gold rush, evident from three new AI smartglass announcements from Chinese companies last week. According to 36kr, Xiaomi is purportedly working on a competitor to the Ray-Ban Meta smartglasses, collaborating with Goertek, a leading XR manufacturer involved with Quest headsets. These are expected by Q2 2025, potentially around April’s Mi Fan Festival. Meanwhile, Baidu released the Xiaodu AI Glasses, equipped with a 16MP camera, AI features, and a robust battery life. Rokid, another major Chinese AR manufacturer, also revealed their Snapdragon AR1-powered Rokid Glasses with intriguing features like QR code payment via Alipay integration. Beyond China, whispers from Reuters suggest Amazon is secretly crafting "Amelia" glasses for their delivery drivers, hinting at a potential revolution in delivery logistics with integrated display guides. The innovation here is palpable, with significant implications for the smartglasses market.

Meta For Education enters beta

Just recently, Meta pulled back the curtain on its Meta For Education initiative, aimed at equipping universities with Quest headsets and specialized education content. This program promises a smooth management experience across devices, allowing educators more control in a classroom environment. Esteemed universities like Arizona State University and Imperial College London are already engaged, providing crucial feedback to enhance this offering. Additionally, Meta has partnered with VictoryXR to develop Europe’s first "metaversities" in universities in the UK, Spain, and Germany. Investing in education seems like a strategic move for Meta, promising not just revenue but fostering early XR adoption among students.

Meta teases Orion operating system

Meta has given us a sneak peek at the user interface possibilities for its Orion glasses through a new video. Although it features multiple UI styles, suggesting Meta is still experimenting, it clearly reflects the unique interface needs of AR glasses compared to VR or MR devices. Developer Alex Coulombe, who sampled Orion at Meta Connect, verified the video’s authenticity, adding some credibility to the showcased designs.

News worth mentioning

• bHaptics introduces a revamped set of devices, including the TactSuit Pro, TactSuit Air, and TactSleeve, each catering to different needs and budgets.
• Horizon Worlds is testing a new currency, Meta Credits, aiming to develop an internal economy where creators can sell digital goods.
• Ekto VR begins shipping its first batch of VR shoes, dubbed Genesis, paving the way for immersive virtual experiences.
• MeRCURY, an XR headset tailored for underwater adventures, launches on IndieGoGo, promising transformative VR experiences in unconventional settings.
• Apple releases two captivating immersive videos, including a music video by The Weeknd and a ‘Concert For One’ featuring Raye.

Some reviews about content

• Square Enix’s Triangle Strategy offers a solid XR experience but feels too much like its flat-screen counterpart.
• DIG VR impresses with its vivid presentation and humor, though some elements of its campaign might feel repetitive.
• EXOcars strikes a delightful balance of realism and fun, delivering an engaging VR racing experience.

Other news highlights

• Sony has halted the adapter needed for using the original PSVR on PS5.
• Pico has introduced an exciting update for Pico OS.
• Apple’s Final Cut Pro now supports editing Spatial Videos.
• Wired details how Meta Horizon Worlds is increasingly inhabited by younger users.
• Quixel megascans are freely available on FAB.
• Vive Ultimate Tracker gains compatibility with third-party headsets.

In addition to these updates, there’s a new XR Design Challenge by Immersive Insiders, providing up-and-coming designers a platform to showcase their innovative ideas. Also, Story offers an intuitive solution for creating spatial content on Vision Pro.

Lastly, I’d like to express my gratitude to all my Patreon supporters. Your encouragement keeps this newsletter thriving. And, if you have the means, please consider donating to the Red Cross efforts in Ukraine. Every bit helps in these challenging times.

(Header image courtesy of Meta)