Schedule

Event

Date

Description

Course Material
Assignment

01/13/2025
Monday

Homework 0 (not graded) released!

[Homework 0 (not graded)]
Lecture

01/13/2025
Monday

Lecture 1 - Introduction
[notes]
Suggested Readings:
- Course Syllabus
- Thrun Chapter 1
- Barfoot Chapter 1
- Computing machinery and intelligence, Turing (2009)
Lecture

01/15/2025
Wednesday

Lecture 2 - Probability Review
[Chapter 2 notes]
Due

01/20/2025 23:59
Monday

Homework 0 Solutions Released
Lecture

01/22/2025
Wednesday

Lecture 3 - Markov Chains and HMM I
[Chapter 2 notes]
Lecture

01/27/2025
Monday

Lecture 4 - HMM II
[Chapter 2 notes]
Assignment

02/03/2025
Monday

Homework 1 released!

[Homework 1]
Lecture

02/03/2025
Monday

Lecture 6 - Baum-Welch & Intro to Kalman Filters
[Chapter 3 notes]
Lecture

02/05/2025
Wednesday

Lecture 7 - Linear State Estimation and Kalman Gain
[Chapter 3 notes] [Class notes]
Lecture

02/10/2025
Monday

Lecture 8 - Markov Decision Process + Kalman Filter
[Chapter 3 notes] [Class notes]
Lecture

02/12/2025
Wednesday

Lecture 9 - Extended Kalman Filter
[Chapter 3 notes] [Class notes]
Lecture

02/17/2025
Monday

Lecture 10 - Unscented Kalman Filter
Lecture

02/19/2025
Wednesday

Lecture 11 - Particle Filter
[Class notes]
Due

02/19/2025 23:59
Wednesday

Homework 1 Due on Gradescope
Lecture

02/24/2025
Monday

Lecture 12 - Rigid Body Transformations
[Chapter 4 notes] [Class notes]
Lecture

02/26/2025
Wednesday

Lecture 13 - Quaternions & Occupancy Grid Mapping
[Chapter 4 notes]
Assignment

03/01/2025
Saturday

Homework 2 released!

[Homework 2]
Lecture

03/01/2025
Saturday

Lecture 5 - Decoding, and Viterbi's Algorithm
[Chapter 2 notes] [Class notes]
Lecture

03/03/2025
Monday

Lecture 14 - Occupancy Grid Mapping and Sesnor Models
[Class notes]
Lecture

03/05/2025
Wednesday

Lecture 15 - Dynamic Programming
[Chapter 5 notes]
Lecture

03/17/2025
Monday

Lecture 16 - Stochastic Dynamic Programming
[Chapter 5 notes]
Lecture

03/19/2025
Wednesday

Lecture 17 - Infite Horizon DP, and Bellman Equation
[Chapter 5 notes]
Due

03/19/2025 23:59
Wednesday

Homework 2 Due on Gradescope
Lecture

03/24/2025
Monday

Lecture 18 - Value Iteration
[Chapter 5 notes]
Lecture

03/26/2025
Wednesday

Lecture 20 - Policy Iteration & Chapter 6 Introduction
[Chapter 5 notes]
Lecture

03/31/2025
Monday

Lecture 20 - Linear Quadratic Regulator
[Chapter 6 notes]
Lecture

04/02/2025
Wednesday

Lecture 21 - Continuous Time Systems and HJB
[Chapter 6 notes]
Lecture

04/07/2025
Monday

Lecture 22 - Stochastic LQR and Duality of LQR and Kalman Filters
[Chapter 6 notes]
Lecture

04/09/2025
Wednesday

Lecture 23 - Iterative LQR, MPC, and Imitation Learning
[Chapter 7 notes]
Lecture

04/14/2025
Monday

Lecture 24 - BC-Stochastic Control and Chapter 8 - Policy Gradients
[Chapter 8 notes]
Lecture

04/16/2025
Wednesday

Lecture 25 - Chapter 8 - Cross-Entropy Methods, and Policy Gradients
[Chapter 8 notes]
Lecture

04/21/2025
Monday

Lecture 26 - The Policy Gradient; Control Variates; Actor-Critic Methods
[Chapter 8 notes]
Lecture

04/23/2025
Wednesday

Lecture 27 - Chapter 9 - Q-Learning
[Chapter 9 notes]
Lecture

04/28/2025
Monday

Lecture 28 - Chapter 9 - Delayed Targets; Double Q-Learning + Closing remarks
[Chapter 9 notes]