The Microsoft Research team, lead by Johannes Kopf, Richard Szeliski, Michael Cohen, and Richard Szeliski, has unveiled a new Windows app that will make shaky first-person videos a thing of the past. Technically speaking, here’s how it works: “Our algorithm first reconstructs the 3D input camera path as well as dense, per-frame proxy geometries. We then optimize a novel camera path for the output video that is smooth and passes near the input cameras while ensuring that the virtual camera looks in directions that can be rendered well from the input. Next, we compute geometric proxies for each input frame. These allow us to render the frames from the novel viewpoints on the optimized path.” Continue reading for the technical video explaining just how the stabilization is accomplished.
The app first creates a 3D map of the original path, and then recreates the clip, shot by shot using a “novel camera path” for smoothness. Next, “the software stitches and blends together each frame into a thankfully smoother viewing experience,” according to Gizmodo.