[tests] implement base model output caching in model-level tests#14059

sayakpaul merged 5 commits into

mainhuggingface/diffusers:mainfrom

cache-base-model-outputhuggingface/diffusers:cache-base-model-outputCopy head branch name to clipboard