Neural Networks Pt. 3: ReLU In Action!!!
StatQuest with Josh Starmer · 8:58
Josh Starmer walks step-by-step through what happens numerically when you swap SoftPlus for ReLU in a tiny neural network's hidden layer (plus an extra ReLU before the output), showing that even though ReLU is just ma...