LatentSync is a cutting-edge, open-source lip-synchronization framework powered by Audio-Conditioned Latent Diffusion Models. By integrating Whisper audio embeddings with advanced temporal alignment (TREPA), it transforms arbitrary audio and video inputs into photorealistic, high-resolution (512x512) talking head videos.
1 comment
[ 2.9 ms ] story [ 11.5 ms ] thread