
Researchers from the University of Maryland have developed a method that uses a NeRF AI neural network capable of reconstructing 3D images from eye reflections. This is possible by using a high-resolution camera to capture multiple images in a fixed position, focused on an individual in motion looking towards the camera.
When zooming in on this passport or driver’s license-sized image, a reflection should be visible in the person’s eye, with a mirror image as well as objects in the area identifiable. Removing the iris from the reflection required=s texture decomposition by the AI, which meant it had to be trained on a 2D texture map that learns its surface before it can remove it.
- GOLF+ — Play your next round at TPC Sawgrass. Get GOLF+, 1,800 in-game credits and more with Meta Quest 3S.
- HOW TO REDEEM — Activate and set up your Meta Quest, pair your Meta Quest with the Meta Horizon app and claim GOLF+ during the pairing process.
- NO WIRES, MORE FUN — Break free from cords. Game, play and explore immersive worlds — untethered and without limits.

We further propose a simple regularization prior on the iris texture pattern to improve reconstruction quality. Through various experiments on synthetic and real-world captures featuring people with varied eye colors, we demonstrate the feasibility of our approach to recover 3D scenes using eye reflections,” said the researchers.


