HN Explorer

Show HN: Dub Anything – Dub videos in each actor's own voice (github.com)

2 points by swax ↗ HN
There are many movies and shows out there with neither subtitles or dubs in English (or any other language). Pretty much impossible to watch.

With SOTA AI now directing the process, you can do it locally on your machine. You basically just clone the repo, open up Codex or Claude and tell it to dub the video you want in the language you want.

The repo contains all the scripts and guidance I've developed over the past few weeks to create dubs that are watchable, as an added bonus the voices in the dub are the actors own voices which is really nice.

Also it's self improving, each dub may modify the scripts for better fidelity. So feel free to push them back to the repo so everyone benefits. Thanks.

9 comments

[ 7.6 ms ] story [ 68.7 ms ] thread
xyxc
This is fantastic. I wonder would it be possible to have a Czech voice?

I am working on translating world of warcraft classic into czech and there is a voice over game addon that makes quest givers speak, instead of you having to read the quest text. I wonder if I could use something like this.

swax
It should work, just clone the repo, open your favorite AI harness and tell it to dub all the WoW audio files into Czech.

It has instructions to extend itself to new languages, so when complete feel free to submit a PR with the Czech support added.

drivingmenuts
> Only dub media you have the rights to, and only clone voices with the consent the use requires. A dub made from someone else's film or voice is for private use unless you have permission.

I wonder how long that will last?

mistaflu
The self-improving part is what I'd like to hear more about. I ship a set of agent instructions as a plugin too, and the hard part is a rule that fixes one case and catches the wrong thing in another
swax
If you're talking about regressions, then yea that's definitely a problem. Currently I'm thinking the AI improves the scripts for its use case locally, being mindful of not breaking other languages. The improvements are submitted by AI, and then I need to use AI again to regression test the improvements.

I've already done it once now with a PR that adds Chinese support, but I think it will need to become more automated with a standard set of videos to test against to catch regressions.

[deleted]
(comment deleted)