Apple's Headset Said To Feature 14 Cameras Enabling Lifelike Avatars

Citing a report from The Information's Wayne Ma (paywalled), MacRumors reports Apple's long-rumored AR/VR headset is said to feature 14 cameras that enable lifelike avatars with accurate facial expressions. The company is also working with former design chief Jony Ive on the project. From the report: For starters, one of the headset's marquee features is said to be lifelike avatars with accurate facial expressions captured by 14 cameras: "Other challenges, such as incorporating 14 cameras on the headset, have caused headaches for hardware and algorithm engineers. The cameras include those that will track the user's face to ensure virtual avatars accurately represent their expressions and mouth movements, a marquee feature." The report adds that Apple's former design chief Jony Ive has remained involved with the headset project as an external consultant to the company: "One person familiar with the matter said Ive's consulting work for Apple since he left includes the headset, adding that he is often brought in to help his former team push through their preferences in areas such as battery, camera placement and ergonomics over those of engineers. Two people said even after Ive left Apple, some employees on the headset project were still required to make the trek from Cupertino to San Francisco, where Ive has a home, to get his approval on changes. Ive has continued to tweak the headset's design. While earlier prototypes had the battery in the headband, he prefers a design that would tether the headset to a battery the user wears, similar to Magic Leap's headset design. It couldn't be learned if this approach will make it into the final design." The initial version of Apple's headset is said to lack a focus on gaming: "Four people who have worked on the project also criticized its lack of focus on gaming, a category of software that appeals to early adopters, which was important to the success of the iPhone and has been a big priority for Meta's VR group. Those people said Rockwell's group almost never mentioned games in internal presentations about possible uses for the headset. Apple isn't developing game controllers for the device and is aiming to use hand tracking or in combination with a clothespin-like finger clip as inputs for the device, multiple people familiar with the project say." On Thursday, Bloomberg reported that Apple executives previewed the upcoming headset to the company's board last week, "indicating that development of the device has reached an advanced stage."

Read more of this story at Slashdot.