Lecture Calendar

 

Number

Date

Topics

Readings

Materials

0

9/27/2024

Introduction

2.1-2.2

Slides:  Overview Download Overview

1A

9/30/2024

Combinatorics, Hashing

1.1, 1.5, 20.1-20.2, 20.5

Slides:  Discrete Download Discrete (1-28)

1B

10/02/2024

Discrete Random Variables, Geometric Distributions

3.1-3.2

Slides:  Discrete Download Discrete (23-54)

1C

10/04/2024

Discrete Random Variables, Expectations

4.1

Slides:  Expected Download Expected (1-29)

2A

10/07/2024

Joint Distributions, Linearity of Expectations

3.3, 4.2

Slides:  Expected Download Expected (27-49)

2B

10/09/2024

Variance, Empirical Distributions

5.1-5.7

Slides:  Expected Download Expected (50-59), Empirical Download Empirical

2C

10/11/2024

Conditional Distributions, Bayes' Rule

2.3-2.6

Slides:  Bayes Download Bayes (1-26)

3A

10/14/2024

Classification Algorithms, Conditional Independence

2.3-2.6

Slides:  Bayes Download Bayes (27-38), Independence Download Independence (1-10)

3B

10/16/2024

Conditional Expectations

4.3-4.4

Slides:  Independence Download Independence (11-23)

3C

10/18/2024

Continuous Variables, Probability Densities, Exponential Distributions

1.3, 7.1-7.3, 12.1-12.3, 10.2

Slides:  Continuous Download Continuous (1-25)

4A

10/21/2024

Variance, Normal (Gaussian) Distributions

9.1-9.3

Slides:  Continuous Download Continuous (24-28), Variance Download Variance

4B

10/23/2024

Classification with Continuous Data, Decision Theory

7.4-7.5 Slides:  Decisions Download Decisions (1-22)

4C

10/25/2024

Sums of Random Variables

8.1-8.3 Slides:  Decisions Download Decisions (19-29), Central Download Central (1-16)

5A

10/28/2024

Review & Questions for Midterm Exam 1

 

Slides:  Midterm 1 Review Download Midterm 1 Review

-

10/30/2024

Midterm Exam 1

 

5C

11/01/2024

Law of Large Numbers, Central Limit Theorem

5.9, 9.4, 15.1-15.3, 18.1-18.2

Slides:  Central Download Central (17-44)

6A

11/04/2024

Polling, Monte Carlo Methods

 19.1-19.3, 13.1

Slides:  Central Download Central (45-55), Monte Carlo Download Monte Carlo (1-9)

6B

11/06/2024

Analysis of Algorithms, Monte Carlo Methods

21.1-21.4

Slides:  Monte Carlo Download Monte Carlo (10-28)

6C

11/08/2024

Application: Monte Carlo Rendering

Slides:  Monte Carlo Download Monte Carlo (29-64)

-

11/11/2024

No Lecture (Veterans Day Holiday)

7B

11/13/2024

Information Theory, Entropy, Feature Selection

MacKay Links to an external site. Chp. 2, 8

Slides:  Entropy Download Entropy (1-36)

7C

11/15/2024

Information Theory, Compression Algorithms

MacKay Links to an external site. Chp. 4, 5

Slides:  Entropy Download Entropy (37-59)

8A

11/18/2024

Review & Questions for Midterm Exam 2

 

Slides:  Midterm 2 Review Download Midterm 2 Review

-

11/20/2024

Midterm Exam 2

 

8C

11/22/2024

Markov Chains

24.1-24.4

Slides:  Markov Download Markov (1-25)

9A

11/25/2024

Markov Chains, Equilibrium Distributions

24.4-24.8, 25.1-25.4, 25.10

Slides:  Markov Download Markov (26-60)

9B

11/27/2024

Application: Language Models

Video:  LLMs Links to an external site.

-

11/29/2024

No Lecture (Thanksgiving Holiday)

10A

12/02/2024

Markov Chains, Entropy Rates and Language

Slides:  Markov Download Markov (56-83)

10B

12/04/2024

Course Review

 

Slides:  Final Review Download Final Review

10C

12/06/2024

Application: Brain Computer Interfaces

 

Slides:  Markov Download Markov (84-99)

-

12/09/2024

Final Exam (4:00-6:00pm)