Loading timeline…
20142010s
Kyunghyun Cho
Co-author of the GRU and of the attention mechanism that reshaped machine translation.
Organizations
New York UniversityUniversité de MontréalGenentech
Major Achievements
- •Co-introduced the gated recurrent unit (2014), a simpler alternative to the LSTM.
- •Co-authored the 2014 attention mechanism with Dzmitry Bahdanau and Yoshua Bengio, the direct precursor of the Transformer.
- •Helped establish encoder–decoder architectures as the standard for neural machine translation.
- •Continued as a leading voice in NLP research and its application to biology.
Key Papers
- Neural Machine Translation by Jointly Learning to Align and Translate
Dzmitry Bahdanau, Kyunghyun Cho, Yoshua Bengio · ICLR 2015 · 2014
- Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Kyunghyun Cho et al. · EMNLP 2014