Loading timeline…
20232020s
Organizations
Meta AI (FAIR)Mistral AI
Major Achievements
- •Led the creation of the original LLaMA model at Meta before leaving to co-found Mistral.
- •Developed extreme optimizations for training efficiency, allowing Mistral to match GPT-4 tier capabilities with a fraction of the compute.
- •A leading architect of sparse-activation neural networks.
Key Papers
- LLaMA: Open and Efficient Foundation Language Models
Hugo Touvron, Thibaut Lavril, Gautier Izacard · arXiv · 2023