Loading timeline…
20122010s
Nitish Srivastava
Lead author of the dropout papers, the regularization method that let large networks train without immediately overfitting.
Organizations
University of TorontoApple
Major Achievements
- •Co-authored the 2012 paper introducing dropout with Geoffrey Hinton's Toronto group.
- •Wrote the definitive 2014 JMLR treatment that made dropout standard practice.
- •Dropout was one of the practical ingredients behind AlexNet's ImageNet result.
- •Contributed to multimodal learning with deep Boltzmann machines.
Key Papers
- Dropout: A Simple Way to Prevent Neural Networks from Overfitting
Nitish Srivastava et al. · Journal of Machine Learning Research · 2014