Microsoft VALL-E Speech Synthesis AI Recreate Voice
You won’t need this Mac Mini-like Windows Dev Kit to run Microsoft’s VALL-E speech synthesis AI, just any modern PC. This new speech synthesis AI model is capable of recreating your voice using just 3-seconds of audio including the tone, charisma, and more. It’s based on EnCodec, a neural codec language model that generates discrete audio codec codes from text and acoustic prompts.

What is a neural codec language model? It basically means that VALL-E breaks how a person sounds into individual components, called tokens, and then uses training data to simulate what that voice would sound like outside of the provided audio sample. So far, they’ve trained it on over 60,000 hours of the English language from more than 7,000 speakers. Check out more More demos here now.

Microsoft Surface Pro 9 (2022), 13" 2-in-1 Tablet & Laptop, Thin & Lightweight, Intel 12th Gen i7 Fast Processor for Multi-Tasking, 16GB RAM, 256GB Storage with Windows 11, Graphite
  • Built on the Intel Evo platform with 12th Gen Intel Core processors.[2]
  • Up to 15.5 hours of batterly life. [4]
  • Adjust the angle with built-in Kickstand.

Microsoft VALL-E Speech Synthesis AI Recreate Voice

We introduced VALL-E, a language model approach for TTS with audio codec codes as intermediate representations. We pre-train VALL-E with 60K hours of speech data, and show the in-context learning capability in zero-shot scenarios. We achieve new state-of-the-art zero-shot TTS results on LibriSpeech and VCTK. Furthermore, VALL-E could keep the acoustic environment and speaker’s emotion in synthesis, and provide diverse outputs in different sampling-based decoding processes,” said the researchers.

Write A Comment