Gradient Descent Optimizers

Compare batch, stochastic, mini-batch, momentum, and Adam as update strategies.

In this module

• Batch, Stochastic, and Mini-Batch
• Momentum Smooths the Route
• Adam Adapts Each Parameter's Step