Neural network optimization: Deep Learning course | Zoonk
13. Neural network optimization
Train networks with stochastic gradient descent, momentum, Adam, learning-rate schedules, warmup, and gradient clipping. Read loss curves and respond to unstable, stalled, or inefficient training.
