BERT (Bidirectional Encoder Representations)

Why It Was Important

Unlike early unidirectional models, BERT read sentences in both directions simultaneously to understand the deep context of each word. Released openly by Google, it was rapidly integrated into Google Search's core algorithm and became the starting baseline for thousands of enterprise NLP tasks globally.

Who Invented It

Jacob Devlin et al. (Google)

NLP researchers focused on bidirectional pre-training.

Applications

• Google Search Ranking
• Question Answering
• Sentiment Analysis Baseline