-
Notifications
You must be signed in to change notification settings - Fork 6.5k
Support LCM in ControlNet and Adapter pipelines. #5822
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| (((4 * 2 + 1) * 16),), | ||
| # (dim=160) The internal feature map will be 5x5 after the first T2I down block (downscaled x32). | ||
| ((4 * 1 + 1) * 32), | ||
| (((4 * 1 + 1) * 32),), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is this change on purpose?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, without this, the parametrized tests were erroing.
| [ | ||
| # (dim=264) The internal feature map will be 33x33 after initial pixel unshuffling (downscaled x8). | ||
| ((4 * 8 + 1) * 8), | ||
| (((4 * 8 + 1) * 8),), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
change on purpose?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice!
|
The failing test is unrelated. Merging now. |
|
@patil-suraj Hi diffusers/src/diffusers/pipelines/t2i_adapter/pipeline_stable_diffusion_adapter.py Line 121 in 42c7e36
Seems like we need a Because when I use Lora in it causes |
|
That is happening because it doesn't inherit the diffusers/src/diffusers/pipelines/t2i_adapter/pipeline_stable_diffusion_adapter.py Line 166 in d486f0e
Unlike Would you like to open a PR for this? |
* support lcm * fix tests * fix tests
* support lcm * fix tests * fix tests
What does this PR do?
This PR adds support for LCM in:
StableDiffusionControlNetPipelineStableDiffusionXLControlNetPipelineStableDiffusionAdapterPipelineStableDiffusionXLAdapterPipelineAlso added fast tests for LCMs with these pipelines.