Artificial intelligence will soon take over the world, or so movies would like us to think. We’re getting closer everyday, thanks to researchers at Massachusetts Institute of Technology (MIT) who have developed predictive Artificial Intelligence (AI) that can learn to see by touching and to feel by seeing. Simply put, this AI system creates realistic tactile signals from visual inputs, and predicts which object and what part is being touched directly from those tactile inputs. “By looking at the scene, our model can imagine the feeling of touching a flat surface or a sharp edge”, said Yunzhu Li, PhD student and lead author from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL).
They employed a KUKA robot arm equipped with a specific tactile sensor known as GelSight, which was developed by another MIT lab. Using a simple web camera, the team captured roughly 200 objects, including tools, household products, clothes, and more, being touched over 12,000 times. Breaking down those 12,000 video segments into static frames, the researchers produced ‘VisGel,’ a dataset of over 3 million visual/tactile-paired pictures.
- GOLF+ — Play your next round at TPC Sawgrass. Get GOLF+, 1,800 in-game credits and more with Meta Quest 3S.
- HOW TO REDEEM — Activate and set up your Meta Quest, pair your Meta Quest with the Meta Horizon app and claim GOLF+ during the pairing process.
- NO WIRES, MORE FUN — Break free from cords. Game, play and explore immersive worlds — untethered and without limits.
