Artificial Intelligence CS 6300 Spring 2022 Schedule: Tue/Thr 12:25-1:45pm Location: WEB 2230 Instructor: John Hollerbach Office Hours: MEB 2178; TH 11:00am -- 12:15pm TA: Arnab Banerjee Office Hours: M 10am-12pm, W 1-3pm MEB 3105

In the readings, RN refers to Russell and Norvig; SB refers to Sutton and Barto.

Date	Topics	Readings	Due	Notes
11 Jan	Introduction to AI	opt: RN 1.1,2
Search
13 Jan	Search I Depth and breadth first search	3.1,3.3,3.4 opt: RN 3.2
18 Jan	Search II A* search and heuristics	3.5-3.6 opt: RN 4.1-4.2	P0 (19 Jan)
20 Jan	Constraint Satisfaction Problems Search, constraints and filtering	RN 6-6.3
25 Jan	Game Playing I Minimax search	RN 5-5.3	HW01
27 Jan	Game Playing II Expectimax search	RN 5.4-5.5
1 Feb	Probability Everything you need to know!	RN 13-13.5 opt: RN 13.6	HW02
3 Feb	Utility Consistency and risk	16-16.3 opt: RN 16.4	P1 (4 Feb)
Reinforcement Learning
8 Feb	Markov Decision Processes I Value iteration	RN 17.1-2 SB 3, 4.4	HW03
10 Feb	Exam 1 Review
15 Feb	Exam 1
17 Feb	Markov Decision Processes II Policy iteration	RN 17.3 SB 4.1-3	P2 (18 Feb)
22 Feb	Reinforcement Learning I TD-Learning	RN 21.1-2 SB 6.1-4
24 Feb	Reinforcement Learning II Q-Learning	RN 21.3 SB 6.5	HW04
1 Mar	Reinforcement Learning III Functional Approximation	RN 21.4-5 SB 8.1,8.2
3 Mar	Non-Instructional Day		HW05
8/10 Mar	Spring break
15 Mar	Reinforcement Learning IV Policy representation and policy search
Reasoning Under Uncertainty
17 Mar	Bayes' Nets I Representation	RN 14-14.4	P3 (18 Mar)
22 Mar	Exam 2 Review		HW06
24 Mar	Exam 2
29 Mar	Bayes' Nets II Independence, factors	RN 14.4-5
31 Mar	Bayes' Nets III Variable elimination, sampling
5 Apr	Decision Diagrams, Markov Chains VPI, Mini-Forward Algorithm	RN 16.5-6, 15.1-3	HW07
7 Apr	Hidden Markov Models I Filtering	RN 15.2
12 Apr	Hidden Markov Models II Viterbi algorithm	RN 15.5	HW08
14 Apr	Hidden Markov Models III Particle filtering, Dynamic Bayes Nets	RN 15.5
19 Apr	Partially-Observable Markov Decision Processes Representation, value iteration	RN 17.4 Dummies, Sec 3-6	HW09
21 Apr	POMDPS II		P4 (22 Apr)
26 Apr	Exam 3 Review		HW10
3 May	Exam 3 10:30 am - 12 pm