Researchers from the University of Maryland have developed a method that uses a NeRF AI neural network capable of reconstructing 3D images from eye reflections. This is possible by using a high-resolution camera to capture multiple images in a fixed position, focused on an individual in motion looking towards the camera.
When zooming in on this passport or driver’s license-sized image, a reflection should be visible in the person’s eye, with a mirror image as well as objects in the area identifiable. Removing the iris from the reflection required=s texture decomposition by the AI, which meant it had to be trained on a 2D texture map that learns its surface before it can remove it.
- NO WIRES, MORE FUN — Break free from cords. Game, play, exercise and explore immersive worlds — untethered and without limits.
- 2X GRAPHICAL PROCESSING POWER — Enjoy lightning-fast load times and next-gen graphics for smooth gaming powered by the SnapdragonTM XR2 Gen...
- EXPERIENCE VIRTUAL REALITY — Take gaming to a new level and blend virtual objects with your physical space to experience two worlds at once.
We further propose a simple regularization prior on the iris texture pattern to improve reconstruction quality. Through various experiments on synthetic and real-world captures featuring people with varied eye colors, we demonstrate the feasibility of our approach to recover 3D scenes using eye reflections,” said the researchers.
