a108i2017 Syllabus Syllabus (http://web.stanford.edu/class/aa228/syllabus/) Reading should be done after the associated lecture. Demonstrations during the lecture will be done in the Julia (http://julialang.org) language using Julia notebooks (notebook.md). Date sep 25 Sep a oct oct oct Oct oct 1 oct 16 oct 18 oct B Oct 5 oct 30 Nov Topic ‘Overview Probabilistic Representations Probabilistic Inference Parameter Learaing Midterm 1 Problem Review Session, 930am- 1020am, @ Gates B03 (bring your questions!) Midterm 1 @ 7.8.0 (in class time 130pm-250pm) Structure Learning Decision Theory and Games Markov Decision Processes ‘Approximate Dynamic Programming Exploration and Exploitation Model-Based Reinforcement Learning. Model-Free Reinforcement Learning, hipilweb stanford edulclass/2a226i¢ylabus! Reading pMu1 pMu2.1 bMu22 pMu23 pMu24 pMU 31-33 DMU 41-44 DMU4.5-4.7 bu 5.1 DMU 52.53 DMU 5.455 Projecto Project 2 18a10si2017 Date Nov 6 Nov Nov 10 Nov 1B Nov 15 Nov 16 Nov 20 Nov 24 Nov a Nov Nov 29 Dec Dec Topic Deep Reinforcement Learning State Uncertainty Exact POMDP Methods Offline POMDP Methods Online POMDP Methods (Take-Home Quiz Released After Lecture) ‘Thanksgiving week ‘Thanksgiving week term 2 Problem Review Session, 930am- 1020am, @ Thornton 102 (bring your questions!) term 2 @ T.B.D (in class time 130pm-250pm) Guest Lectures ‘Optimal Aircraft Rerouting during Commercial Space Launches [Rachael Tompa} ‘The Valve of Inferring the Internal State of Traffic Participants for Autonomous Freeway Driving [Zach Sunberg] MDP Policy Compression through Neural Networks {Kyle Julian] Guest Lectures hipilweb stanford edulclass/2a226i¢ylabus! Syllabus Reading Due Slides images/drl.pat) DMU 61-62 Project 2 bMu63 bMu64 Proposal due at 1159pm bMu6s Take- home Quiz Slides (images/aa228guest/rachael.pptx) Slides (images/aa228guest/zach.pdf) Slides (images/aa228guest/iyle.pptx) 218a10si2017 Date Dee n Dec B Topic Cooperative Control Using Deep Reinforcement Learning [Max Egorov / Jayesh Gupta] Modeling Human Driver Behavior with Imitation Learning [Jeremy Morton] Making POMDPs Great Again [Louis Dressel] No class No class Syllabus Reading Due Slides (images/aa228guest/maxim.pdt) or folder (images/aaz28guest/max.zip) Slides (images/aa22aguest/jeremy.pptx) Slides (images/aa228guest/louis.pptx) Final Project Paper Peer Review" Note: The dates for the various topics are approximate. Some topics may span multiple lectures. However, the schedule for the midterms will stay fixed. *Peer review can be submitted remotely online ©All rights reserved. Powered by Hugo (https://gohugo.io/) and sustain (http://www.github.com/nurlansu/hugo-sustain/) with ¥ hipilweb stanford edulclass/2a226i¢ylabus!