Loading timeline…
20172010s
Ashish Vaswani
Lead author of 'Attention Is All You Need', which introduced the Transformer.
Organizations
Google BrainAdept AIEssential AI
Major Achievements
- •First author of the 2017 paper that eliminated RNNs in favor of purely attention-based architectures.
- •His work enabled the massive parallelization required to train Large Language Models.
- •Co-founded multiple startup companies (Adept, Essential) to commercialize foundation models.
Key Papers
- Attention Is All You Need
Ashish Vaswani et al. · NeurIPS 2017
Videos
Stanford CS25: V3 I How I Learned to Stop Worrying and Love the Transformer
Stanford Online
Ashish Vaswani on Essential AI's Journey with MI300X & Open Models
AMD Developer Central