Answered step by step
Verified Expert Solution
Question
1 Approved Answer
Given a NN with two neurons as shown in the following figure, where x 1 , x 2 are two inputs, each represents a binary
Given a NN with two neurons as shown in the following figure, where are two inputs, each
represents a binary bit. We plan to use the simple network to approximate XOR of two bits, and the
desired learning samples are listed in the table.
In this NN model, the activation function at the hidden neuron is Relu, and the activation function at the
output neuron is sigmoid function. We apply the cost function in training, where is the
output and is the target value of the output. Note that the batch gradient descent means that we
consider the four training samples at once when we compute the gradients.
Discuss why crossentropy loss is not a good choice of the cost function in the above task.
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started