[LoRA] minor fix for load_lora_weights() for Flux and a test#11595

sayakpaul merged 4 commits into

mainhuggingface/diffusers:mainfrom

flux-delete-adaptershuggingface/diffusers:flux-delete-adaptersCopy head branch name to clipboard