What happens when you combine NVIDIA Omniverse and its AI-powered Audio2Face application with Epic Games’ Unreal Engine 5? Realistic digital singing humans of course, or at least in the hands of Anderson Rohr, a 3D artist and freelance video editor from southern Brazil. To create a slightly creepy lip-sync cover of “Bad Moon Rising,” Rohr used his own voice and an NVIDIA Studio system with a GeForce RTX 3090 GPU.
First, Rohr had to record himself singing before importing the file into Audio2Face. This application, which built on Omniverse using NVIDIA AI technology, automatically generates expressive facial animations for digital humans using just a voice-over track or any other audio source. Next, the eyes, brows, and neck of his digital character had to be manually before moving onto tweaking the lighting.
NVIDIA Omniverse is helping me achieve more natural results for my digital humans and speeding up my workflow, so that I can spend more time on the creative process. Omniverse goes beyond my expectations without drastically changing my workflows. I see myself using it a lot, and I hope my artwork inspires people to seek real-time results for virtual productions, games, cinematic scenes or any other creative project,” said Rohr.
