Apply ControlNet to a Video (huggingface.co)

2 points by mr-ai 3y ago ↗ HN

1 comment

[ 3.5 ms ] story [ 10.3 ms ] thread

So, this works frame by frame using SD, extracting a pose (for example) and generating a new frame using the prompt and the pose, then re-encoding gen'd frames as a video?

Seems interesting. Any demos?