Apple's Headset Said to Feature 14 Cameras Enabling Lifelike Avatars, Jony Ive Has Remained Involved With Design

Earlier this week, The Information's Wayne Ma outlined struggles that Apple has faced during the development of its long-rumored AR/VR headset. Now, in a follow-up report, he has shared several additional details about the wearable device.

apple ar headset concept 1

Apple headset render created by Ian Zelbo based on The Information reporting

For starters, one of the headset's marquee features is said to be lifelike avatars with accurate facial expressions captured by 14 cameras:

Other challenges, such as incorporating 14 cameras on the headset, have caused headaches for hardware and algorithm engineers. The cameras include those that will track the user's face to ensure virtual avatars accurately represent their expressions and mouth movements, a marquee feature.

The report adds that Apple's former design chief Jony Ive has remained involved with the headset project as an external consultant to the company:

One person familiar with the matter said Ive's consulting work for Apple since he left includes the headset, adding that he is often brought in to help his former team push through their preferences in areas such as battery, camera placement and ergonomics over those of engineers. Two people said even after Ive left Apple, some employees on the headset project were still required to make the trek from Cupertino to San Francisco, where Ive has a home, to get his approval on changes.

Ive has continued to tweak the headset's design. While earlier prototypes had the battery in the headband, he prefers a design that would tether the headset to a battery the user wears, similar to Magic Leap’s headset design. It couldn't be learned if this approach will make it into the final design.

The initial version of Apple's headset is said to lack a focus on gaming:

Four people who have worked on the project also criticized its lack of focus on gaming, a category of software that appeals to early adopters, which was important to the success of the iPhone and has been a big priority for Meta's VR group. Those people said Rockwell's group almost never mentioned games in internal presentations about possible uses for the headset. Apple isn't developing game controllers for the device and is aiming to use hand tracking or in combination with a clothespin-like finger clip as inputs for the device, multiple people familiar with the project say.

As previously reported, Apple was considering having its headset be tethered to an external base station for some computing tasks, but the headset is now expected to be a fully standalone device. The report claims that the base station was going to use the same chip that was later announced as the M1 Ultra for the Mac Studio.

The headset itself is expected to be powered by two chips, with a streaming codec to reduce latency. The main chip in the headset will be equivalent to the M2 chip that is expected to debut in new MacBook Air and iPad models later this year, the report claims.

The full-length report can be read at The Information with a subscription.

Apple's headset is currently expected to be released in 2023. Bloomberg's Mark Gurman recently reported that Apple's board of directors received a demo of the headset last week, suggesting that the device is nearing completion.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Buy Now)
Related Forum: Apple Vision Pro

Top Rated Comments

UltimateSyn Avatar
24 months ago

The initial version of Apple's headset is said to lack a focus on gaming
I figured that gaming would be its primary focus. Wonder what it's actually meant for.
Score: 20 Votes (Like | Disagree)
LiE_ Avatar
24 months ago

Apple's former design chief Jony Ive has remained involved
So it's going to be very thin, unibody and have no power off button ?
Score: 12 Votes (Like | Disagree)
gwhizkids Avatar
24 months ago

Bore off, so not into this AR/VR stuff... it simply isn't there right now...
You in 2006: "So not into this smartphone stuff...it simply isn't there right now..."
Score: 12 Votes (Like | Disagree)
contacos Avatar
24 months ago
In case this gets archived like the initial iPod / iPad responses:

Who is this for? I don’t see a use case. B2B market?
Score: 11 Votes (Like | Disagree)
djcerla Avatar
24 months ago

Apple isn't developing game controllers for the device and is aiming to use hand tracking or in combination with a clothespin-like finger clip as inputs for the device
If you need a game controller, you blew it.
Score: 9 Votes (Like | Disagree)
TheYayAreaLiving ?️ Avatar
24 months ago
Looks like this is Jony I've last product.

That is alot of camera's in one device. Hopefully it's not going to give me an eye infection or any of the eye sight problems.
Score: 8 Votes (Like | Disagree)

Popular Stories

reset password request iphone

Warning: Apple Users Targeted in Phishing Attack Involving Rapid Password Reset Requests

Tuesday March 26, 2024 4:34 pm PDT by
Phishing attacks taking advantage of Apple's password reset feature have become increasingly common, according to a report from KrebsOnSecurity. Multiple Apple users have been targeted in an attack that bombards them with an endless stream of notifications or multi-factor authentication (MFA) messages in an attempt to cause panic so they'll respond favorably to social engineering. An...
iPhone Home Screen Gradient Blank Spaces 1

Sources: iOS 18 Lets Apps Be Placed Anywhere on Home Screen Grid

Sunday March 24, 2024 1:33 pm PDT by
iOS 18 will give iPhone users greater control over Home Screen app icon arrangement, according to sources familiar with the matter. While app icons will likely remain locked to an invisible grid system on the Home Screen, to ensure there is some uniformity, our sources say that users will be able to arrange icons more freely on iOS 18. For example, we expect that the update will introduce...
Generic iOS 18 Feature Purple

iOS 18: What to Expect From 'Biggest' Update in iPhone's History

Wednesday March 27, 2024 11:10 am PDT by
At least some Apple software engineers continue to believe that iOS 18 will be the "biggest" update in the iPhone's history, according to Bloomberg's Mark Gurman. Below, we recap rumored features and changes for the iPhone. "The iOS 18 update is expected to be the most ambitious overhaul of the iPhone's software in its history, according to people working on the upgrade," wrote Gurman, in a r...
maxresdefault

Apple Announces WWDC 2024 Event for June 10 to 14

Tuesday March 26, 2024 10:02 am PDT by
Apple today announced that its 35th annual Worldwide Developers Conference is set to take place from Monday, June 10 to Friday, June 14. As with WWDC events since 2020, WWDC 2024 will be an online event that is open to all developers at no cost. Subscribe to the MacRumors YouTube channel for more videos. WWDC 2024 will include online sessions and labs so that developers can learn about new...
apple maps 3d feature

Apple Maps May Gain Custom Routes With iOS 18

Tuesday March 26, 2024 3:10 pm PDT by
Apple may be planning to add support for "custom routes" in Apple Maps in iOS 18, according to code reviewed by MacRumors. Apple Maps does not currently offer a way to input self-selected routes, with Maps users limited to Apple's pre-selected options, but that may change in iOS 18. Apple has pushed an iOS 18 file to its maps backend labeled "CustomRouteCreation." While not much is revealed...
iPad Pro 2024 Landscape Camera Feature

New iPad Pro Again Rumored to Feature Landscape Front-Facing Camera

Monday March 25, 2024 5:43 am PDT by
The next-generation iPad Pro will feature a landscape-oriented front-facing camera for the first time, according to the Apple leaker known as "Instant Digital." Instant Digital reiterated the design change earlier today on Weibo with a simple accompanying 2D image. The post reveals that the entire TrueDepth camera array will move to the right side of the device, while the microphone will...
sonoma desktop wwdc

Apple Releases macOS Sonoma 14.4.1 With Fix for USB Hub Bug

Monday March 25, 2024 10:10 am PDT by
Apple today released macOS Sonoma 14.4.1, a minor update for the macOS Sonoma operating system that launched last September. macOS Sonoma 14.4.1 comes three weeks after macOS Sonoma 14.4. The ‌‌‌‌macOS Sonoma‌‌ 14.4‌.1 update can be downloaded for free on all eligible Macs using the Software Update section of System Settings. There's also a macOS 13.6.6 release for those who...