The Algorithm that Helps Machines Learn [AdamW]
Jia-Bin Huang · 7:19
This video traces the evolution of deep learning optimizers from plain gradient descent to AdamW, showing exactly which failure mode each successive idea (momentum, RMSProp, Adam, bias correction, decoupled weight dec...