$3$ points

Which activation function listed below is commonly used in the hidden layers of modern neural networks?

Rectfied Linear Units $($ReLU$)$

Sigmoid Activation Functio

Hyperbolic Tangent Activation Function

Softmax Activation Function