You can either play video games to control characters that can agilely evolve in virtual environments, or use Disney Research’s PuppetPhone. Simply put, this augmented reality experience reduces the gap between physical toys and virtual characters. As you move your smartphone around, a puppet responds in real time to the manipulations seen through the screen. “The virtual character moves in order to follow the user gestures, as if it was attached to the phone via a rigid stick,” according to the paper. Read more for the video and additional information.
“This yields a natural interaction, similar to moving a physical toy, and the puppet now feels alive because its movements are augmented with compelling animations. Using the smartphone, our method ties together the control of the character and camera into a single interaction mechanism. We validate our system by presenting an application in Augmented Reality,” adds Disney Research.