Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Consider a neural network that represents the following function: hat ( y ) = ( w 5 ( w 1 x 1 + w 2

Consider a neural network that represents the following function:
hat(y)=(w5(w1x1+w2x2)+w6(w3x3+w4x4))
where xi denotes input variables, hat(y) is the output variable, and is the logistic function:
(x)=11+e-x.
Suppose the loss function used for training this neural network is the L2 loss, i.e.L(y,hat(y))=
(y-hat(y))2. Assume that the network has its weights set as:
(w1,w2,w3,w4,w5,w6)=(-0.65,-0.55,1.74,0.79,-0.13,0.93)
[3.a](5 marks) Draw the computational graph for this function. Define appropriate in-
termediate variables on the computational graph. (break the logistic function into smaller
components.)
[3.b](5 marks) Given an input data point (x1,x2,x3,x4)=(1.2,-1.1,0.8,0.7) with true
label of 1.0, compute the partial derivative delLw3, by using the back-propagation algorithm.
Indicate the partial derivatives of your intermediate variables on the computational graph.
Round all your calculations to 4 decimal places.
image text in transcribed

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image_2

Step: 3

blur-text-image_3

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Databases Illuminated

Authors: Catherine M Ricardo, Susan D Urban

3rd Edition

1284056945, 9781284056945

More Books

Students also viewed these Databases questions

Question

Provide examples of KPIs in Human Capital Management.

Answered: 1 week ago

Question

What are OLAP Cubes?

Answered: 1 week ago