Engineer Fletcher Heisler of Everything is Hacked managed to build a full-body game controller that can be used to play Mortal Kombat II, Super Mario World, Star Fox, Flappy Bird and more. This controller relies on MediaPipe’s Pose Landmarker to perform real-time detection of body landmarks from video input.
The requirements are an external monitor, webcam, and enough space stand far enough away from a built-in camera to fit multiple bodies with extended limbs. Keystrokes are mapped to commands in games, while multiplayer basically splits the captured image into halves. Unfortunately, there aren’t any games made specifically for this controller, so not all the commands can be mapped properly, but Super Mario Kart is great for getting a workout in.
- Experience total immersion with 3D positional audio, hand tracking and easy-to-use controllers working together to make virtual worlds feel real.
- Explore an expanding universe of over 500 titles across gaming, fitness, social/multiplayer and entertainment, including exclusive releases and...
- Enjoy fast, smooth gameplay and immersive graphics as high-speed action unfolds around you with a fast processor and immersive graphics.
The primary way to ‘type’ custom defined keys or key combinations is by extending arms and raising legs at various angles, with some additional recognized motions such as covering the mouth, crossing the arms, jumping, and squatting,” said Fletcher.
