Lec 03. Approximation Theory
MIT OpenCourseWare · 82:42
A 3-layer ReLU MLP that is wide enough can approximate any Lipschitz function on the unit hypercube, so shallow nets are already universal approximators — but that fact alone does not tell you how to pick an architect...