ControlNeXt-SVD

Video Lecture

Section	Video Links
ControlNeXt-SVD

Description

Enhancing AnimateDiff to work with SVD

Install ComfyUI nodes for ControlNext-SVD v2

Install the custom node ComfyUI nodes for ControlNeXt-SVD v2 using the manager, or you can use your command/terminal prompt.

Navigate to your ComfyUI/custom_nodes folder.

Run,

git clone https://github.com/kijai/ComfyUI-ControlNeXt-SVD.git

Restart ComfyUI

Install the ControlNeXt SVD V2 Unet model

Download controlnext-svd_v2-unet-fp16_converted.safetensors and save into your ComfyUI/models/diffusion_models folder.

📂 ComfyUI/
├── 📂 models/
│   ├── 📂 diffusion_models/
│   │   └── controlnext-svd_v2-unet-fp16_converted.safetensors

Dance Styles

K-Pop	Macarena
Download MP4	Download MP4

Workflows

Workflow	Initial Image	Output

Neutral poses for creating initial frames.

Close Body Pose	Full Body Pose

WGET Commands

If you are using Runpod, or a similar hosted GPU service, then you can access your running pod/instance using a terminal.

# CD into ./ComfyUI/models/diffusion_models/ folder
wget https://huggingface.co/Kijai/ControlNeXt-SVD-V2-Comfy/resolve/main/controlnext-svd_v2-unet-fp16_converted.safetensors

# CD into ./ComfyUI/input/ folder
wget https://sbcode.net/img/02.mp4
wget https://sbcode.net/img/eve-macarena.mp4

Wait for files to download fully before running your workflows.

Troubleshooting

Error : `ModuleNotFoundError: No module named 'matplotlib'`

Navigate to your ComfyUI_windows_portable folder.