Skip to content

OpenPose ControlNet

Video Lecture

Section Video Links
OpenPose ControlNet OpenPose ControlNet OpenPose ControlNet

Description

We will extract the poses from some existing images and use them to guide the generation of new images.

Sample Poses

Prompts

  • A highly fashionable model standing in front of a white wall, wearing nice shoes, looking happy, relaxed and optimistic.
  • A highly fashionable model running in front of a white wall, wearing nice shoes, looking happy, relaxed and optimistic.
  • A highly fashionable model walking in front of a white wall, wearing nice shoes, looking happy, relaxed and optimistic.
  • A highly fashionable model smiling at the camera showing their hands.
  • A highly fashionable model smiling at the camera showing their hands clapping.
  • A highly fashionable model smiling at the camera showing their hands folded into fists.

OpenPose ControlNet Models

Place the required models into your ComfyUI/models/controlnet folder.

Base ControlNet Model (Depth)
SD1.5 control_v11p_sd15_openpose_fp16.safetensors
SDXL control-lora-openposeXL2-rank256.safetensors 
📂 ComfyUI/
├── 📂 models/
│   ├── 📂 controlnet/
│   │   ├── control_v11p_sd15_openpose_fp16.safetensors
│   │   └── control-lora-openposeXL2-rank256.safetensors

Optional SD1.5 Checkpoints

realisticVisionV60B1_v51HyperVAE.safetensors
majicmixRealistic_v7.safetensors

📂 ComfyUI/
├── 📂 models/
│   ├── 📂 checkpoints/
│   │   ├── realisticVisionV60B1_v51HyperVAE.safetensors
│   │   └── majicmixRealistic_v7.safetensors

WGET Commands

If you are using Runpod, or a similar hosted GPU service, then you can access your running pod/instance using a terminal.

#
#
#
# CD into ./ComfyUI/models/controlnet/ folder
wget https://huggingface.co/comfyanonymous/ControlNet-v1-1_fp16_safetensors/resolve/main/control_v11p_sd15_openpose_fp16.safetensors
wget https://huggingface.co/thibaud/controlnet-openpose-sdxl-1.0/resolve/main/control-lora-openposeXL2-rank256.safetensors

#
#
#
# CD into ./ComfyUI/models/checkpoints/ folder
wget https://huggingface.co/JCTN/Juggernaut/resolve/main/realisticVisionV60B1_v51HyperVAE.safetensors
wget https://huggingface.co/GreenGrape/231209/resolve/045ebfc504c47ba8ccc424f1869c65a223d1f5cc/majicmixRealistic_v7.safetensors

Wait for files to download fully before running your workflows.

https://openposeai.com/