Load pretrained model from CLIP repo to this SLIP repo

[yjhong89]

Hi.

Is there any code snippet loading pretrained model from CLIP repo to this SLIP repo ?

• Left One is CLIP pretrained model from this repo, and Right one is another CLIP pretrained model from CLIP repo
• As you see. key names are different, and some tensor have differenet shape (768 != [1,1,768])

Thank you!