Initialization and normalization: Deep Learning course | Zoonk
14. Initialization and normalization
Control signal and gradient flow with principled weight initialization, residual connections, batch normalization, layer normalization, and related methods. Diagnose exploding, vanishing, and poorly scaled activations.