Skip to content

FLUX IP-Adapter

Video Lecture

Section Video Links
Flux IP-Adapter Flux IP-Adapter Flux IP-Adapter
Video Outline Introduces IP Adapter with Flux for image-guided generation.
Explains installing the ComfyUI IP adapter Flux custom node.
Guides downloading and placing the `ip_adapter.bin` model file.
Shows improving text prompts for better initial results.
Demonstrates integrating the IP adapter into the workflow.
Mentions first-time download of additional 3.5GB SIGLIP files.
Notes GPU/CPU options for Flux model loading.
Shows how IP adapter improves image styling significantly.
Advises using Flux-generated images as input for best results.
Explores generating images with or without an open pose.

Description

Using the IP-Adapter with Flux Dev & Schnell.

Install the Custom Node

Install the custom node ComfyUI-IPAdapter-Flux using the manager, or you can use your command/terminal prompt.

  1. Navigate to your ComfyUI/custom_nodes folder.
  2. Run, 
    git clone https://github.com/Shakker-Labs/ComfyUI-IPAdapter-Flux.git
  3. Restart ComfyUI

Install the IP-Adapter model

Download ip-adapter.bin.

Create a new folder under ComfyUI\models\ named ipadapter-flux.

Save ip-adapter.bin in the new folder.

Workflow Assets

Start Workflow Image Prompt

Poses

Pose Image Prompt
A highly fashionable model standing in front of a white wall, wearing nice shoes, looking happy, relaxed and optimistic.
A highly fashionable model smiling at the camera showing their hands folded into fists.
4 pictures in a grid with 4 distinct poses, top left smile, top right peace sign, bottom left silly, bottom right fun

Tip

The Flux IP-Adapter does not produce perfect results based on the input image. But you can get quite close. You will need to work on your prompt as best you can. Once you have a good prompt, continue to generate images using random seeds, until you get the best result you can. Once you produce a good match, then take note of that seed, set the KSampler to this seed, and set it as fixed, and then continue to reuse this same seed in future generations. If you don't like the output at any time, don't change the seed, but try tweaking the prompt instead. For best consistency in your images, keep your seed fixed once you've found a good reliable one.