jdhao's blog
·
The Warmup Trick for Training Deep Neural Networks
📝
内容提要
Warmup is a training technique often used in training deep neural networks. In this post, I will try to explain what is warmup, and how does it work.
➡️
