[LoRA] make set_adapters() method more robust.#9535

sayakpaul merged 7 commits intomainhuggingface/diffusers:mainfrom

better-set-adaptershuggingface/diffusers:better-set-adaptersCopy head branch name to clipboard