Lecture 9: Sequences

Topics

• Feedforward Language Models
• Introduction to Recurrent Neural Networks;
• Variations: Stacking and Bi-directionality;
• Introduce to Tagging; Part of Speech Tagging;

Reading: JM Ch9 Links to an external site., JM Ch8 Links to an external site.

Slides: lecture-09-sequences.pdf Download lecture-09-sequences.pdf

Video

Other Links

• Char-RNNs Links to an external site. (and  followup on N-grams Links to an external site.);
• Chris Olah's Blog Links to an external site.;
• Practical Neural Networks for NLP Links to an external site.;