Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

This question provides a simple two-layer neural network with a hidden layer of three neurens, an output layer of one neuron and two input neurons

image text in transcribed

This question provides a simple two-layer neural network with a hidden layer of three neurens, an output layer of one neuron and two input neurons In both the hidden layer and the output layer, the sigmoid function is considered as an activation function. X=[x1,x2] is a vector that the network receives as input. A parameter vector called W(1)=[w1,w2,w3,w4,w5,w6] connects the input layer to the hidden layer. A parameter vector W(2)=[w7,w8,w9] is the parameter that connects the hidden layer to the output layer (examples shown in the figure below). (a) Write the mathematical expression for the output of the hidden layer, including the bias term. (10%) (b) Write the mathematical expression for the output of the output layer, including the bias term. (10\%) (c) The true label for this input is y=0. The cost function used in this network is the mean squared error (MSE). Write the mathematical expression for the cost for this input. (10\%) (d) Use backpropagation to calculate the gradient descent of the cost with respect to the weights connecting the input layer to the hidden layer [w1,w2,w3,w4,w5,w6] and the weights connecting the hidden layer to the output layer [w7,w8,w9]. (10\%)

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access with AI-Powered Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Students also viewed these Databases questions