Use gradients as change signals - Deep Learning | Zoonk
Use gradients as change signals
Interpret a gradient as a signal that says which direction would make the loss go up or down for one weight. You’ll reason about a knob change before actually updating the model.