Lecture Calendar

 

Number

Date

Topics

Readings

Materials

1A

4/02/2024

Introduction to Statistical Learning, Graphical Models

1, 2, 3.1-3.3

Slides:  Overview Download Overview

1B

4/04/2024

Generative Models for Classification, Decision Theory

10.1-10.2, 8.7, 13

Slides:  Decisions Download Decisions (1-40)

2A

4/09/2024

Linear Regression, Least Squares

8.4, 8.8, 17.1-17.2

Slides:  Decisions Download Decisions (38-51), Estimation Download Estimation

2B

4/11/2024

Bayesian Linear Regression, Regularization

18.1

Slides:  Regression Download Regression (1-58)

3A

4/16/2024

Linear Classification, Bayesian Logistic Regression

17.4, 18.2

Slides:  Regression Download Regression (59-71), Logistic Download Logistic (1-37)

3B

4/18/2024

Kernels, Gaussian Processes

17.3, 19.3

Slides:  Logistic Download Logistic (38-45), Kernels Download Kernels (1-30)

4A

4/23/2024

Gaussian Processes, Support Vector Machines

19.1-19.2, 19.5, 17.5

Slides:  Kernels Download Kernels (31-56)

4B

4/25/2024

Bayesian Optimization, Stochastic Optimization

BO Tutorial Links to an external site., Kernels and Neural Networks Links to an external site.

Slides:  Stochastic Download Stochastic, BO Download BO

5A

4/30/2024

Clustering, Mixture Models

20.1-20.3

Slides:  BO Download BO, Mixtures Download Mixtures (1-37)

5B

5/02/2024

Expectation Maximization (EM) Algorithm

11.1-11.2

Slides:  Mixtures Download Mixtures (38-82)

6A

5/07/2024

Hidden Markov Models: Viterbi Algorithm

23.1-23.2

Slides:  Mixtures Download Mixtures (83-94),  HMMs Download HMMs (1-28)

6B

5/09/2024

Hidden Markov Models: Forward-Backward, EM

23.3, 23.5

Slides:  HMMs Download HMMs (29-70)

7A

5/14/2024

Dimensionality Reduction, PCA

15.1-15.3

Slides:  PCA Download PCA (1-22)

7B

5/16/2024

Factor Analysis, EM Algorithm, State Space Models

21.1-21.4, 24.1-24.4

Slides:  PCA Download PCA (23-64)

8A

5/21/2024

Variational Inference, Topic Models

28.3, Topic Tutorial Links to an external site.

Slides:  Variational Download Variational

8B

5/23/2024

Topic Models, Stochastic Variational Inference

Topic Tutorial Links to an external site.

Slides:  Variational Download Variational

9A

5/28/2024

Deep Generative Models, Variational Autoencoders

VAE Tutorial Links to an external site.

Slides:  Variational Download Variational

9B

5/30/2024

Sequential Deep Generative Models

Dynamical VAEs Links to an external site.

Slides:  Variational Download Variational

10A

6/04/2024

Belief Propagation, (Dynamic) Bayesian Networks

4.1, 4.4, 5.1, 23.4

Slides:  BP Download BP, DBN Download DBN

10B

6/06/2024

Diffusion Generative Models

Denoising Diffusion Models Links to an external site., Latent Diffusion Models Links to an external site.

-

6/13/2024

Final Project Reports Due