Meta’s 3D Codec Avatars is a project consisting of deep generative model of 3D human faces that achieves state of the art reconstruction performance while being computationally efficient and adaptive to the rendering conditions during execution. This typically requires a hardware intensive setup, like MUGSY (171 cameras), but soon, a simple smartphone scan could be all it takes.
All you would need is a smartphone boasting a front-facing depth sensor, like the iPhone’s FaceID. Just pan the phone around your face, and then once more while copying 65 facial expressions. The entire process reportedly takes only 3.5-minutes to complete, but processing it will require hours using a PC with four high end GPUs over the cloud. This is somewhat similar to Epic Games’ RealityScan app.
- Experience total immersion with 3D positional audio, hand tracking and easy-to-use controllers working together to make virtual worlds feel real.
- Explore an expanding universe of over 500 titles across gaming, fitness, social/multiplayer and entertainment, including exclusive releases and...
- Enjoy fast, smooth gameplay and immersive graphics as high-speed action unfolds around you with a fast processor and immersive graphics.
Telecommunication with photorealistic avatars in virtual or augmented reality is a promising path for achieving authentic face-to-face communication in 3D over remote physical distances,” said Meta.
