This page provides a tentative schedule of all lectures for the coures. The precise timing of some of these lectures could change. Slides for future lectures are provided, but are from a previous version of the course; updated slides for each lecture will be posted prior to class each day. Lecture videos for the public online course, when they are available, will be posted on this page along with each set of slides.
| Date (CMU) | Lecture | Instructor | Slides | Video (2022 version) |
|---|---|---|---|---|
| 8/25 | 1 - Introduction / Logistics | Dettmers | YouTube | |
| 8/27 | 2 - ML Refresher / Softmax Regression | Dettmers | YouTube | |
| 9/1 | 3 - Manual Neural Networks / Backprop | Dettmers | YouTube (pt 1) YouTube (pt 2) | |
| 9/3 | 4 - Automatic Differentiation | Chen | YouTube | |
| 9/8 | 5 - Automatic Differentiation Implementation | Chen | ipynb | YouTube |
| 9/10 | 6 - Optimization | Dettmers | YouTube | |
| 9/15 | 7 - Neural Network Library Abstractions | Chen | YouTube | |
| 9/17 | 8 - Normalization, Dropout, + Implementation | Dettmers | YouTube | |
| 9/22 | 9 - NN Library Implementation | Chen | ipynb | YouTube |
| 9/24 | 10 - Convolutional Networks | Dettmers | YouTube | |
| 9/29 | 11 - Hardware Acceleration for Linear Algebra | Chen | YouTube | |
| 10/1 | 12 - Hardware Acceleration + GPUs | Chen | YouTube | |
| 10/6 | 13 - Hardware Acceleration Implementation | Chen | ipynb | YouTube |
| 10/8 | 14 - Convoluations Network Implementation | Dettmers | ipynb | YouTube |
| 10/13 | No class - Fall Break | |||
| 10/15 | No class - Fall Break | |||
| 10/20 | 15 - Sequence Modeling + RNNs | Dettmers | YouTube | |
| 10/22 | 16 - Sequence Modeling Implementation | Dettmers | ipynb | YouTube |
| 10/27 | 17 - Transformers and Autoregressive Models | Dettmers | Youtube | |
| 10/29 | 18 - Transformers Implementation | Dettmers | ipynb | Youtube |
| 11/3 | No class - Democracy Day | |||
| 11/5 | 19 - Training Large Models | Chen | YouTube | |
| 11/10 | 20 - Generative Models | Chen | YouTube | |
| 11/12 | 21 - Generative Models Implementation | Chen | ipynb | YouTube |
| 11/17 | 22 - Customize Pretrained Models | Chen | ||
| 11/19 | 23 - Model Deployment | Chen | Youtube | |
| 11/24 | 25 - Future Directions / Q&A | Both | ||
| 11/67 | No class - Thanksgiving | |||
| 12/1 | 26 - Student project presentations | Students | ||
| 12/3 | 26 - Student project presentations | Students | ||
| 12/7 | x - Overflow student project presentations | Students |