Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

The structure of a Neural Network is given below. W W Y H X1 X2 H The input value X = X2 X-8 and

The structure of a Neural Network is given below. W W Y H X1 X2 H The input value X = X2 X-8 and the desired output value is Y The initial weight matrix for the first layer W: w = [WW] = [36] 4 (1) The bias weight matrix W 1 The initial weight matrix for the second layer W2: w = [ww] = 2 3 4 3 (2) The bias weight matrix W = [] Perform the following tasks: Forward propagation: calculate the value of the hidden nodes using sigmoid function as the activation function, and obtain the predicted value for output nodes using softmax as the output function. Com- pute the gradient of the output VY using cross-entropy loss function. Back propagation: Given VY, obtain the gradients for the weight matrix and bias vector for each layer. Update the weight matrix and bias vectors for each layer with their estimated gradients, using a learning rate of 0.5, and then compute the output value using the updated weight matrices. Verify that the updated weight matrices have reduced the output loss function, as compared to those obtained using the initial weight matrices For each task above, write out its equations and the estimated values.

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image_2

Step: 3

blur-text-image_3

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Business Analytics

Authors: Jeffrey D. Camm, James J. Cochran, Michael J. Fry, Jeffrey W. Ohlmann

5th Edition

0357902211, 978-0357902219

More Books

Students also viewed these Programming questions

Question

Why do young children hide by covering their eyes?

Answered: 1 week ago