Support IPAdapter for all Flux pipelines- not only for txt2img

[almog2065]

I see diffusers recently merged the IPAdapter for Flux pipelines, but only for txt2img pipeline. #9825
The feature request is about supporting IPAdapter to all Flux pipelines as img2img, sketch2img and more..

It will be great to have load_ip_adapter and unload_ip_adapter for all those pipelines:
(FluxControlNetPipeline, FluxImg2ImgPipeline, FluxInpaintPipeline)

For now this support works only for FluxPipeline(txt2img only)

I see the feature can be implemented by adding the FluxIPAdapterMixin to the pipeline class.

[asomoza]

cc: @hlky

[hlky]

Hi @almog2065. We are planning to add IPAdapter in other Flux pipelines, we can add this issue to the Roadmap for next release. If you'd like to contribute a PR for any of the Flux pipelines we are happy to assist, each needs similar pipeline changes and changes for the pipeline's tests - we don't necessarily need slow tests for all pipelines though it can be covered by FluxIPAdapterTesterMixin.

[SahilCarterr]

PR #10708