MIT EECS6.7960 Deep Learning |
||
Fall 2026 |
||
Description: Fundamentals of deep learning, including both theory and applications. Topics include neural net architectures (MLPs, CNNs, RNNs, transformers), geometry and invariances in deep learning, backpropagation and automatic differentiation, learning theory and generalization in high-dimensions, and applications to computer vision, natural language processing, and robotics.
Pre-requisites: 18.05 and (6.3720, 6.3900, or 6.C01)
Note: This course is appropriate for advanced undergraduates and graduate students, and is 3-0-9 units. Due to heavy enrollment, we will very unfortunately not be able to take cross-registrations this semester.
Any and all personal or logistical questions, such as regarding absenses, accomodations, etc should be emailed to the course email, 6.7960-instructors@mit.edu, and not to the instructors directly.
ningrz at mit dot edu
ylanaxu at mit dot edu
aimeeyu at mit dot edu
amitsch at mit dot edu
akchang at mit dot edu
anakhag at mit dot edu
abora at mit dot edu
ashkanso at mit dot edu
cindywei at mit dot edu
dbaek at mit dot edu
gmanso at mit dot edu
j_austin at mit dot edu
lsheldon at mit dot edu
maggiejl at mit dot edu
dengm at mit dot edu
rebecca1 at mit dot edu
shobhita at mit dot edu
surajrdy at mit dot edu
txw at mit dot edu
vzxiao at mit dot edu
xbai at mit dot edu
** class schedule is subject to change **
| Date | Topics | Speaker | Course Materials | Assignments | |
| Week 1 | |||||
| Thu 9/10 | Course overview, introduction to deep learning | Kaiming He |
Slides
Optional Reading: Notation for this course Neural Networks |
||
| Week 2 | |||||
| Tue 9/15 | How to train a neural net | Phillip Isola |
Slides Required Reading: Gradient-Based Learning Backprop Optional Reading: Old Optimizer, New Norm: An Anthology |
pset 1 out | |
| Thu 9/17 | Approximation theory | Phillip Isola |
Slides Interactive Demo Optional Reading: Deep learning theory notes sections 2 and 5 (this is written at a rather advanced level; try to get the intuitions rather than all the details) |
||
| Thu 9/17 | PyTorch Tutorial: 6:00-7:00 PM, 34-101 | Aryan Bora | Pytorch Tutorial Colab | ||
| Week 3 | |||||
| Tue 9/22 | Architectures: ConvNets | Kaiming He |
Slides Required Reading: CNNs Optional Reading: CS231n: Convolutional Neural Networks |
||
| Tue 9/22 | Agentic Coding Tutorial: 6:00-7:00 PM, 32-123 | Anakha Ganesh |
GitHub Slides |
||
| Thu 9/24 | Architectures: Memory and Sequence Modeling | Kaiming He | |||
| Thu 9/24 | Agentic Coding Tutorial: 6:00-7:00 PM, 32-123 | Suraj Reddy | |||
| Week 4 | |||||
| Tue 9/29 | Architectures: Transformers | Phillip Isola |
pset 1 due
pset 2 out |
||
| Thu 10/1 | Generalization Theory | Phillip Isola | |||
| Week 5 | |||||
| Tue 10/6 | Going Deep with Neural Networks | Kaiming He | |||
| Thu 10/8 | Representation Learning Methods | Kaiming He | |||
| Week 6 | |||||
| Tue 10/13 | No class — Monday schedule |
pset 2 due pset 3 out |
|||
| Thu 10/15 | Representation Learning: Weight-Space Geometry | Phillip Isola | |||
| Week 7 | |||||
| Tue 10/20 | Representation Learning: Information Theory | Kaiming He | |||
| Thu 10/22 | Foundation models: pre-training | Phillip Isola | |||
| Week 8 | |||||
| Tue 10/27 | Foundation models: scaling laws | Phillip Isola |
pset 3 due pset 4 out |
||
| Thu 10/29 | Midterm | ||||
| Week 9 | |||||
| Tue 11/3 | Generative models: basics | Kaiming He | |||
| Thu 11/5 | Generative models: VAE and GAN | Kaiming He | |||
| Week 10 | |||||
| Tue 11/10 | Generative models: Diffusion and Flows | Kaiming He |
pset 4 due pset 5 out |
||
| Thu 11/12 | Generalization (OOD) | Phillip Isola | |||
| Week 11 | |||||
| Tue 11/17 | Transfer learning: Models and Data | Phillip Isola | |||
| Thu 11/19 | Inference-time Algorithms | Phillip Isola | |||
| Week 12 | |||||
| Tue 11/24 | Guest Lecture 1 | TBD | |||
| Thu 11/26 | No class — Thanksgiving | ||||
| Week 13 | |||||
| Tue 12/1 | Evaluation | Phillip Isola | pset 5 due | ||
| Thu 12/3 | Applying Deep Learning to Your Problems | Kaiming He | |||
| Week 14 | |||||
| Tue 12/8 | Guest Lecture 2 | TBD | |||
| Thu 12/10 | Guest Lecture 3 | TBD | |||
| Week 15 | |||||
| Tue 12/15 | Final Exam | ||||
Office hours are listed on the calendar below. You can also add this calendar to your own Google Calendar.