Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

a) Suppose we are training a neural network with one linear output unit (i.e. its output is same as its net input) and no hidden

image text in transcribed

a) Suppose we are training a neural network with one linear output unit (i.e. its output is same as its net input) and no hidden units for a binary classification task. Instead of using the typical squared error function, we want to use the following error function (which is known as cross-entropy error): E[w]=[ylogo+(1y)log(1o)] where y is the target value ( 0 or 1 ) and o is the output produced by our current network. What is the update rule we should use for adjusting our weights during learning with this error function? Hint: The derivative of log(a) is a1. b) In neural networks, the sigmoid function determines the activation values of the units in the hidden layer. For an MLP implementing non-linear regression the update rules are the following: vhwhj=t(rtyt)zht=t(rtyt)vhzht(1zht)xjt where xjt is input at unit j and zht is the activation function of hidden unit h. Derive the update rules for an MLP implementing the same non-linear regression with two hidden layers, where the second layer uses the index . Use w2h to denote weights between the 1 st and the 2 nd hidden layers and w1hj to denote weights between the input layer and the 1st hidden layer. (Recall the backpropogation rule wE=yEz2yz1z2wz1 )

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Fundamentals Of Database Systems

Authors: Sham Navathe,Ramez Elmasri

5th Edition

B01FGJTE0Q, 978-0805317558

More Books

Students also viewed these Databases questions

Question

love of humour, often as a device to lighten the occasion;

Answered: 1 week ago

Question

orderliness, patience and seeing a task through;

Answered: 1 week ago

Question

well defined status and roles (class distinctions);

Answered: 1 week ago