Lec 20. Scaling Laws
MIT OpenCourseWare · 38:22
This lecture explains neural scaling laws: empirically observed power-law relationships that predict how model loss (and some downstream scores) change as you scale compute, data, and parameters, and why labs use thos...