NeRF AI Neural Network Reconstruct 3D Images Eye Reflections
Researchers from the University of Maryland have developed a method that uses a NeRF AI neural network capable of reconstructing 3D images from eye reflections. This is possible by using a high-resolution camera to capture multiple images in a fixed position, focused on an individual in motion looking towards the camera.



When zooming in on this passport or driver’s license-sized image, a reflection should be visible in the person’s eye, with a mirror image as well as objects in the area identifiable. Removing the iris from the reflection required=s texture decomposition by the AI, which meant it had to be trained on a 2D texture map that learns its surface before it can remove it.

Meta Quest 3S 128GB | VR Headset — Golf+ Included — Tee Off in VR | VR Gaming, High-Definition...
  • GOLF+ — Play your next round at TPC Sawgrass. Get GOLF+, 1,800 in-game credits and more with Meta Quest 3S.
  • HOW TO REDEEM — Activate and set up your Meta Quest, pair your Meta Quest with the Meta Horizon app and claim GOLF+ during the pairing process.
  • NO WIRES, MORE FUN — Break free from cords. Game, play and explore immersive worlds — untethered and without limits.

NeRF AI Neural Network Reconstruct 3D Images Eye Reflections
NeRF AI Neural Network Reconstruct 3D Images Eye Reflections

We further propose a simple regularization prior on the iris texture pattern to improve reconstruction quality. Through various experiments on synthetic and real-world captures featuring people with varied eye colors, we demonstrate the feasibility of our approach to recover 3D scenes using eye reflections,” said the researchers.

Author

A technology, gadget and video game enthusiast that loves covering the latest industry news. Favorite trade show? Mobile World Congress in Barcelona.