This is the audio equivalent of the Face2Face algorithm that takes one person's face and places it onto the character in a video, matching the latter subject's expressions.
This means we now live in a world where you can create a recording of Donald Trump saying, "I colluded with the Russians to rig the election," and not only have the voice sound like Trump but also bring along his personal expressive style so that it becomes indistinguishable from Trump himself.
Would love to see these two combined - make an audio-video recording of an actor confessing to election fraud, then use Face2Face to swap in Trump's face and use Tacotron to swap in his voice.
Note that this is separate from the other front page post about Google Cloud TTS powered by WaveNet. That's a product, while this is exciting new research (which will hopefully become part of a product).
10 comments
[ 2.9 ms ] story [ 33.7 ms ] threadThis means we now live in a world where you can create a recording of Donald Trump saying, "I colluded with the Russians to rig the election," and not only have the voice sound like Trump but also bring along his personal expressive style so that it becomes indistinguishable from Trump himself.
Would love to see these two combined - make an audio-video recording of an actor confessing to election fraud, then use Face2Face to swap in Trump's face and use Tacotron to swap in his voice.
This web demo allows you to enter your own text:
https://cloud.google.com/text-to-speech/
(select US American and Wavenet)
Nope! These two papers are fresh work on prosody modeling. You can see the evolution of work this team has been publishing about here:
https://google.github.io/tacotron/
> This web demo allows you to enter your own text:
That web demo is unrelated to this. It's about a Google Cloud TTS API, which only includes WaveNet, not Tacotron.
https://cloudplatform.googleblog.com/2018/03/introducing-Clo...
Ha!