Describe the bug

I am getting key error, while trying to change the ip adapter to "ip-adapter-plus-face_sd15.bin" model of h94/IP-Adapter
Reproduction
Just take sample code of IP adapter - LCM Lora from new release v0.24.0 of diffusers
& change model weight_name from "ip-adapter_sd15.bin" to "ip-adapter-plus-face_sd15.bin"
Logs
No response
System Info
Google colab
diffusers
version: 0.24.0
- Platform: Linux-5.15.120+-x86_64-with-glibc2.35
- Python version: 3.10.12
- PyTorch version (GPU?): 2.1.0+cu118 (True)
- Huggingface_hub version: 0.19.4
- Transformers version: 4.35.2
- Accelerate version: 0.24.1
- xFormers version: not installed
- Using GPU in script?:
- Using distributed or parallel set-up in script?:
Who can help?
@sayakpaul @yiyixuxu @DN6 @patrickvonplaten