Forget makeup, Disney Research uses a projector-based illumination to alter the appearance of human performers in real-time during performances. Using infrared illumination, an optically and computationally aligned high-speed camera detects facial orientation as well as expression, while the estimated expression blend-shapes are mapped onto a lower dimensional space.
The facial motion and non-rigid deformation are then estimated, smoothed and predicted through adaptive Kalman filtering. Last, but not least, the desired appearance is generated interpolating pre-computated offset textures according to time, global position, and expression.
- Magical Recreation - Relive the magic with this delightful LEGO Ideas Pooh Bear house set, perfect for adults, Disney fans, and all Winnie the Pooh...
- Authentic Accessories Inside - The house opens at the back for easy access to the authentic accessories inside, including a buildable armchair,...
- Pooh Bear Storybook - Includes a Pooh Bear storybook, honey pots, Poohsticks, Pooh Bear's buildable red balloon, and the Sanders name over the door.
We have evaluated our system through an optimized CPU and GPU prototype, and demonstrated successful low latency augmentation for different performers and performances with varying facial play and motion speed. In contrast to existing methods, the presented system is the first method which fully supports dynamic facial projection mapping without the requirement of any physical tracking markers and incorporates facial expressions,” said the researchers.
