Skip to main content

Apple’s Vision Pro headset will turn you into a digital avatar when FaceTiming

Apple’s Vision Pro headset will turn you into a digital avatar when FaceTiming

/

The Vision Pro headset will use a ‘neural network’ to scan your face and create a hyperrealistic avatar.

Share this story

If you buy something from a Verge link, Vox Media may earn a commission. See our ethics statement.

An image showing the persona feature in FaceTime
Image: Apple

Apple’s Vision Pro headset will let you replace your face with a hyperrealistic avatar when you’re using FaceTime. As shown during WWDC 2023, you can scan your face using the headset to create a digital “persona” of yourself that will appear during video calls.

Unlike the cartoony avatars you can make with apps like Microsoft Teams and Meta’s Horizon Worlds, it looks like Apple is aiming to create a virtual version of your face that’s accurate to how you really look. In the video Apple showed at WWDC, a user holds the headset in front of their face, allowing the device to scan it with “an advanced encoder-decoder neural network” that Apple says has been trained on a “diverse group of thousands of individuals.”

A GIF of a man scanning his face using Apple’s virtual reality headset.
GIF: Apple

From there, Apple’s Vision Pro headset creates your digital persona, which can track your face and hand movements while you’re using FaceTime with the headset. It’s hard to tell how well this feature actually works from the video alone, but the persona looks fairly realistic, aside from an apparent lack of hair texture.

Either way, it seems like a viable solution to using FaceTime when you don’t have a camera pointed directly at your face (like you would when using the app with an iPhone or Mac). But I’m still looking forward to seeing how it performs when not in a controlled setting, and I have lots of questions about what you can and can’t do when scanning your face (like wearing a scary mask).

Apple’s Vision Pro headset is powered by the company’s new mixed reality operating system, called visionOS, and will cost $3,499 when it’s released early next year.


Related: