TTIC 31230: Fundamentals of Deep Learning Winter 2019 (not yet updated to Winter 2020)

Generalization and Regularization

Slides

Problems

Paper on Over-Parameterization

PAC-Bayes Tutorial

A Paper on computing PAC-Bayes bounds in practice (2017)

The Alexnet Paper Demonstraing Dropout (2012)

The Journal Dropout Reference (2014)

Effective Dropout for RNNs (2015)