Skip to content

ControlNets from Video

Video Lecture

Section Video Links
ControlNets from Video ControlNets from Video ControlNets from Video

Description

We can create ControlNets from Videos.

In this lesson we will create a few ControlNets from videos so that we can use them in later lessons to help guide the video generation process.

Download MP4 OpenPose Depth
Walking left to right
Jogging right to left
Jogging left to close right

Final Output

If you had trouble creating the ControlNet videos in this lesson, then you can download and extract the contents of this zip file into your ComfyUI/input folder.

walking-controlnets.zip

WGET Commands

If you are using Runpod, or a similar hosted GPU service, then you can access your running pod/instance using a terminal.

#
#
#
#
# CD into ./ComfyUI/input/ folder
wget https://sbcode.net/genai/img/walking-left-2-right.mp4
wget https://sbcode.net/genai/img/jogging-right-2-left.mp4
wget https://sbcode.net/genai/img/jogging-left-2-close-right.mp4

Wait for files to download fully before running your workflows.