Answered step by step
Verified Expert Solution
Question
1 Approved Answer
Write your answer to three decimal places. Consider we have a cross-entropy loss function for binary classification: L=[yln(a)+(1y)ln(1a)], where a is the probability out from
Write your answer to three decimal places.
Consider we have a cross-entropy loss function for binary classification: L=[yln(a)+(1y)ln(1a)], where a is the probability out from the output layer activation function. We've built a computation graph of the network as shown below. The blue letters below are intermediate variable labels to help you understand the connection between the network architecture graph above and the computation graph. When y=1, what is the gradient of the loss function w.r.t. W11? Write your answer to three decimal places. Note: Please use the computation graph method. One can calculate the gradient directly using chain rules, but if the computation graph is not used at all, it will not score properly. Try to fill the red boxes above. This question does not need coding and the answer can be easily obtained analytically. Hint: You may use the property of z(z)=(1)Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started