Name		Name	Last commit message	Last commit date
Latest commit History 6 Commits
docs		docs
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md

Repository files navigation

Learning to Grow Pretrained Models for Efficient Transformer Training

Peihao Wang¹, Rameswar Panda², Lucas Torroba Hennigen⁴, Philip Greengard³, Leonid Karlinsky², Rogerio Feris², David Cox², Zhangyang (Atlas) Wang¹ Yoon Kim⁴

¹University of Texas at Austin, ²MIT-IBM Watson Lab, ³Columbia University, ⁴MIT

Project Page | Paper

Code coming soon...

About

[ICLR 2023] "Learning to Grow Pretrained Models for Efficient Transformer Training" by Peihao Wang, Rameswar Panda, Lucas Torroba Hennigen, Philip Greengard, Leonid Karlinsky, Rogerio Feris, David Cox, Zhangyang (Atlas) Wang, Yoon Kim

Custom properties

Report repository

Releases

No releases published

Packages

Contributors