Stochastic Gradient Descent, Clearly Explained!!!
StatQuest with Josh Starmer · 10:53
Stochastic gradient descent (SGD) is regular gradient descent with one change: instead of plugging every data point into every derivative at each step, you randomly pick one sample (or a small mini-batch) per step — w...