Facebook’s TextStyleBrush, the company’s latest AI research project, needs just a photo of a single word to emulate your handwriting style. This means that you’ll easily be able to edit and replace text in images, making it the first self-supervised AI model that replaces text in images of both handwriting and scenes using a single example word. It opens the door to advancements in personalized messaging and captions, such as photo-realistic translation of languages in augmented reality (AR).
Typically, AI can synthetically reconstruct historic scenes or modify photos to resemble the style of famous artists, but this system is flexible enough to understand the nuances of both text in real-world scenes and handwriting is a much harder AI challenge. In other words, it’s capable of understanding unlimited text styles for different typography and calligraphy as well as multiple transformations, like rotations, curved text, and deformations.
- Dive into extraordinary experiences with a mixed reality headset that transforms your home into an exciting new playground, where virtual elements...
- It’s the most powerful Quest yet*, featuring next-level performance with more than double the graphic processing power of Quest 2. (*Based on the...
- Experience more immersion with dazzling visuals with the 4K+ Infinite Display (a nearly 30% leap in resolution from Quest 2) and rich 3D audio with...
TextStyleBrush proves that it’s possible to build AI systems that can learn to transfer text aesthetics with more flexibility and accuracy than what was possible before — using a one-word example. We’re continuing to improve our system through some limitations that we’ve run into, like text written in metallic objects or characters in different colors,” said Facebook.
