3. Show that the derivative of the softmax, yi = exp(ai)/



j exp(aj ), is ∂yi/∂aj =

yi(δij − yj ), where δij is 1 if i = j and 0 otherwise.