Add Custom Timesteps Support to LCMScheduler and Supported Pipelines #5874
Conversation
…which support LCMScheduler (img2img, inpaint).
…es which support LCMScheduler (img2img, inpaint).
…ince make fix-copies doesn't appear to work correctly (it deletes the whole pipeline).
|
The documentation is not available anymore as the PR was closed or merged. |
| # 4. Prepare timesteps | ||
| self.scheduler.set_timesteps(num_inference_steps, device=device) | ||
| timesteps = self.scheduler.timesteps | ||
| if timesteps is not None: |
There was a problem hiding this comment.
very nice!
Could we maybe factor this out into a function:
timesteps = retrieve_timesteps(self.scheduler, timesteps)and then use #copied from for all pipelines?
patrickvonplaten
left a comment
patrickvonplaten
left a comment
There was a problem hiding this comment.
Thanks a lot for opening this PR - I think that's a good idea! Could we maybe try to make use of # Copied from by factoring out the function (similarly to:
)
|
@patrickvonplaten I have refactored the timestep handling logic into a |
This looks great - very nice job! Merging! |
…uggingface#5874) * Add custom timesteps support to LCMScheduler. * Add custom timesteps support to StableDiffusionPipeline. * Add custom timesteps support to StableDiffusionXLPipeline. * Add custom timesteps support to remaining Stable Diffusion pipelines which support LCMScheduler (img2img, inpaint). * Add custom timesteps support to remaining Stable Diffusion XL pipelines which support LCMScheduler (img2img, inpaint). * Add custom timesteps support to StableDiffusionControlNetPipeline. * Add custom timesteps support to T21 Stable Diffusion (XL) Adapters. * Clean up Stable Diffusion inpaint tests. * Manually add support for custom timesteps to AltDiffusion pipelines since make fix-copies doesn't appear to work correctly (it deletes the whole pipeline). * make style * Refactor pipeline timestep handling into the retrieve_timesteps function.
…uggingface#5874) * Add custom timesteps support to LCMScheduler. * Add custom timesteps support to StableDiffusionPipeline. * Add custom timesteps support to StableDiffusionXLPipeline. * Add custom timesteps support to remaining Stable Diffusion pipelines which support LCMScheduler (img2img, inpaint). * Add custom timesteps support to remaining Stable Diffusion XL pipelines which support LCMScheduler (img2img, inpaint). * Add custom timesteps support to StableDiffusionControlNetPipeline. * Add custom timesteps support to T21 Stable Diffusion (XL) Adapters. * Clean up Stable Diffusion inpaint tests. * Manually add support for custom timesteps to AltDiffusion pipelines since make fix-copies doesn't appear to work correctly (it deletes the whole pipeline). * make style * Refactor pipeline timestep handling into the retrieve_timesteps function.
3 participants
What does this PR do?
This PR adds custom
timestepssupport toLCMScheduler.set_timestepsand pipelines which supportLCMScheduler(e.g.LatentConsistencyModelPipeline,StableDiffusionPipeline,StableDiffusionXLPipeline). This gives users the flexibility to try out timestep schedules beyond the "standard" LCM inference schedule (as calculated whennum_inference_stepsis given toLCMScheduler.set_timesteps).Before submitting
documentation guidelines, and
here are tips on formatting docstrings.
Who can review?
Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.
@patrickvonplaten
@patil-suraj
@luosiallen