This page provides a tentative schedule of all lectures for the coures. The precise timing of some of these lectures could change. Slides and video recordings will be released during the courses of the semester. CMU lecture videos for all lectures are available here (requires CMU login).

Lecture videos for the public online course, when they are available, will be posted on this page along with each set of slides.

Date (CMU) Date (online) Lecture Instructor Slides Video
8/30 9/13 1 - Introduction / Logistics Kolter pdf
pdf (online)
YouTube
9/1 9/15 2 - ML Refresher / Softmax Regression Kolter pdf YouTube
9/6 9/20 3 - Manual Neural Networks / Backprop Kolter pdf YouTube (pt 1) YouTube (pt 2)
9/8 9/22 4 - Automatic Differentiation Chen pdf YouTube
9/13 9/27 5 - Automatic Differentiation Implementation Chen ipynb YouTube
9/15 9/29 6 - Optimization Kolter pdf YouTube
9/20 10/4 7 - Neural Network Library Abstractions Chen pdf  
9/22 10/6 8 - NN Library Implementation Chen ipynb  
9/27 10/11 9 - Normalization, Dropout, + Implementation Kolter pdf  
9/29 10/13 10 - Convolutional Networks Kolter pdf  
10/4 10/25 11 - Hardware Acceleration for Linear Algebra Chen    
10/6 10/27 13 - Hardware Acceleration + GPUs Chen    
10/11 11/1 14 - Hardware Acceleration Implementation Chen    
10/13 11/3 15 - Convoluations Network Implementation Kolter    
10/18   Fall Break      
10/20   Fall Break      
10/25 11/8 15 - Training Large Models Chen    
10/27 11/10 16 - Architecture Overview Hardware Acceleration Chen    
11/1 11/15 17 - Generative Adversarial Networks Chen    
11/3 11/17 18 - Generative Adversarial Networks Implementation Chen    
11/8 11/22 19 - Sequence Modeling + RNNs Kolter    
11/10 11/29 20 - Sequence Modeling Implementation Kolter    
11/15 12/1 21 - Transformers + Attention Kolter    
11/17 12/6 22 - Transformers + Attention Implementation Kolter    
11/22 12/8 23 - Implicit Layers Kolter    
11/29 12/13 24 - Model Deployment Chen    
12/1 12/15 25 - Machine Learning Compilation and Deployment Implementation Chen    
12/6 12/15 26 - Future Directions / Q&A Both    
12/8 - 27 - Student project presentations Students