Project Primrose blurred the lines between fashion and technology, while Adobe Magic Fixup just wants to make your photo-editing life easier. How so? It adopts a basic cut-and-paste like approach that will enable users to fixup those edits automatically.
This generative model that synthesizes a photorealistic output that follows the prescribed layout when given a coarsely edited image. Magic Fixup’s method essentially transfers fine details from the original image and preserve the identity of its parts, while also adapting it to the lighting and context defined by the new layout. It achieves this by training the AI model on videos, and then relies on two different diffusion models that operate simultaneously. One deals with the reference image, pulling out the required detail for recreation, and the second synthesizes the user’s coarse edit from the reference image.
No products found.
We show that by using simple segmentations and coarse 2D manipulations, we can synthesize a photorealistic edit faithful to the user’s input while addressing second-order effects like harmonizing the lighting and physical interactions between edited objects,” said the researchers.
[Source]
