Activation Functions

Compare sigmoid, tanh, ReLU, and softmax by their jobs and gradient behavior.

In this module

• Sigmoid and Tanh
• ReLU and Its Variants
• Softmax for Competing Classes