Loading timeline…
20172010s
Noam Shazeer
Transformer co-author and mixture-of-experts pioneer who later co-founded Character.AI.
Organizations
GoogleCharacter.AIGoogle DeepMind
Major Achievements
- •Co-authored 'Attention Is All You Need' (2017), introducing the Transformer architecture.
- •Pioneered sparsely-gated mixture-of-experts layers, the technique behind today's largest models.
- •Co-founded Character.AI in 2021, returning to Google in 2024.
- •Contributed to Google's Meena and LaMDA conversational systems.
Key Papers
- Attention Is All You Need
Ashish Vaswani et al. · NeurIPS 2017
- Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Noam Shazeer et al. · ICLR 2017