Calendar

Week 1

Jan 17

Lec 1Course Introduction: Recording

Project 0 out

UMich discussion link - Intro to Python, Pytorch, and Colab: 📖 GBC Ch. 1

Jan 19

Lec 2Image Classification: Recording

: 📖 231n Image Classification

Week 2

Jan 24

Lec 3Linear Classifiers: Recording

Project 0 due Project 1 out

UMich discussion link - Intro to PROPS dataset: 📖 Chen et al., ProgressLabeller

Jan 26

Lec 4Regularization + Optimization

Quiz 1: 📖 231n Optimization

: 📖 GBC Sec 8.1-8.6

: 📖 Li et al., Visualizing Loss Landscaps

: 📖 Goh, Why Momentum Really Works

Jan 27

Final Project Topic out

Week 3

Jan 31

Lec 5Neural Networks: Recording

Final Project Topic List by Students

UMich discussion link - How to read research papers?: 📖 231n Neural Networks

: 📖 GBC Sec 6.1-6.4

: 📖 Nielsen, Universal Approximation

Feb 02

Lec 6Backpropagation: Recording

Quiz 2: 📖 cs231n Backpropagation

: 📖 GBC Sec 6.5-6.6

: 📖 Olah, Backpropagation

Week 4

Feb 07

Lec 7Convolutional Neural Networks: Recording

Quiz 3: 📖 cs231n ConvNets

: 📖 GBC Ch. 9

: 📖 Araujo et al., Receptive Fields of CNNs

: 📖 Olah et al., Feature Visualization

Feb 09

Lec 8CNN Architectures: Recording

Project 1 due Project 2 out

Quiz 4: 📖 Krizhevsky et al., AlexNet

: 📖 Simonyan and Zisserman, VGG

: 📖 Szegedy et al., GoogLeNet

: 📖 He et al., ResNet

Week 5

Feb 14

Lec 9Training Neural Networks I: Recording

: 📖 cs231n Training I

: 📖 Olah et al., Equivariance in Networks

Feb 16

Lec 10Training Neural Networks II: Recording

Quiz 6: 📖 cs231n Training II

: 📖 Goodfellow et al., Adversarial Examples

Week 6

Feb 21

Lec 11Deep Learning Software: Recording

Quiz 7: 📖 MSI Notes

Project 2 due Project 3 out: 📖 Redmon, Darknet

: 📖 Jia et al., Caffe

: 📖 Abadi et al., TensorFlow

: 📖 Paszke et al., PyTorch

Feb 23

Lec 12Object Detection: Recording

Quiz 8: 📖 Girshick et al., R-CNN

: 📖 Redmon et al., YOLO

: 📖 Lin et al., FCOS

Feb 24

Paper Selection Due

Week 7

Feb 28

Lec 13Object Detection and Semantic Segmentation: Recording

Quiz 9: 📖 Girshick et al., R-CNN

: 📖 Redmon et al., YOLO

: 📖 Lin et al., FCOS

Mar 02

Lec 14Student Lecture - RGB-D Perception and Network Architectures: Recording (umn.edu reqd)

Final Project Proposal Due: 📃 Related Papers

Spring Break

Mar 07: Break
Mar 09: Break

Week 8

Mar 14

Final Project Pitches

Mar 16

Guest Lecture Prof. Yu Xiang - University of Texas at Dallas: Recording

Project 4 out: 📃 Slides

Week 9

Mar 21

Lec 15Student Lecture - Rigid Object Perception, Category-level Object Pose Estimation: Recording (umn.edu reqd)

Project 3 due: 📃 Related Papers

Mar 23

Guest Lecture Mohit Shridhar - University of Washington at Seattle: Recording

: 📃 Slides

Week 10

Mar 28

Lec 16Student Lecture - Object Tracking, Transformers: Recording (umn.edu reqd)

Quiz 12: 📃 Related Papers

Mar 30

Lec 17Student Lecture - Implicit Surfaces, Geometry, NeRF: Recording (umn.edu reqd)

Project 4 due

Quiz 13: 📃 Related Papers

Week 11

Apr 04

Lec 18Student Lecture - NeRFs and their variants: Recording (umn.edu reqd)

Quiz 14: 📃 Final Proj Admin Slides

: 📃 Related Papers

Apr 06

Lec 19Student Lecture - Visual Pre-training for Robot Manipulation: Recording (umn.edu reqd)

Quiz 15: 📃 Related Papers

Week 12

Apr 11

Final Project Checkpoint Presentations

Final Project Checkpoint

Apr 13

Lec 20Student Lecture - Visual Odometry and Localization: Recording (umn.edu reqd)

Quiz 16: 📃 Related Papers

Week 13

Apr 18

Lec 21Student Lecture - Tactile Perception for Robot Grasping and Manipulation: Recording (umn.edu reqd)

Quiz 17: 📃 Related Papers

Apr 20

Lec 22Student Lecture - Imitation Learning, Visual-Language Models for Robot Manipulation: Recording (umn.edu reqd)

Quiz 18: 📃 Related Papers

Week 14

Apr 25

Guest LectureDr. Sai Vemprala - Microsoft, Seattle: Recording

: 📃 Slides

Apr 26

Apr 27

Final Project Poster Presentations at 164 Shepherd Labs - Drone Lab

Week 15

May 01: Final video and report due
May 02: In-class video evaluation