Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

5.) Given a set of N triplets {x,x,y}, 1 sis N, the goal is to design a model to predict yl) based on the features

image text in transcribed

5.) Given a set of N triplets {x",x,y}, 1 sis N, the goal is to design a model to predict yl) based on the features xand x,. For this, we use the following neural network. In this model, the weights W2,W2, ...,Wy and bi x2 W1 +-F. b3 single neuron W3 y b2 . +-fo single neuron W4 +-fo single neuron Hidden Layer W5 W2 W6 + the biases bu, b2, bz should be learned. The (nonlinear) activation function f(.) is defined as (positive integer q is a network model parameter which is fixed in advance): f(z) = (2z + [z]) The mean squared error of the network is measured by E(W1, W2, ..., W6, b1,b2, bz) ) pW (y(0) )(w,W2, ..., W6, bz, b2, bz))? a) Write down the gradients of the mean squared error E(W1, W2, ...,Wo, bu, b2, bz) with respect to all the parameters. Show an outline of your derivation (you do not need to compute the exact derivatives, but sufficiently describe the outline). (Hint: look at pages 8-13 of the uploaded Deep Learning document) b) Describe a gradient descent algorithm to estimate the parameters. c) For q = 1, can you derive an equivalent but simpler neural network (i.e., a network without a hidden layer)? Prove your answer. d) For q = 1, is the model equivalent to a linear regression model? Explain your

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Datacasting How To Stream Databases Over The Internet

Authors: Jessica Keyes

1st Edition

007034678X, 978-0070346789

More Books

Students also viewed these Databases questions

Question

600 lb 20 0.5 ft 30 30 5 ft

Answered: 1 week ago

Question

Develop a program for effectively managing diversity. page 303

Answered: 1 week ago

Question

List the common methods used in selecting human resources. page 239

Answered: 1 week ago