Lecture 6: Language Modeling

Topics

• Wrapup Word Embeddings
• Language Modeling: Task and Evaluation;
• Generative Models: Unigram, Bigram, Trigram, and Smoothing;

Reading: JM Ch3 Links to an external site.;

Video

Slides: lecture-06-lang-models.pdf Download lecture-06-lang-models.pdf

Other Links

• Collins' notes Links to an external site.;
• Google N-Grams Viewer Links to an external site.;
• Visualizing Language Models Links to an external site.;