Question: 1 Suppose you had a neural network with linear activation functions. That is, for each unit the output is some constant c times the weighted

1 Suppose you had a neural network with linear activation functions. That is, for each unit the output is some constant c times the weighted sum of the inputs.

a. Assume that the network has one hidden layer. For a given assignment to the weights w, write down equations for the value of the units in the output layer as a function of w and the input layer x, without any explicit mention of the output of the hidden layer.
Show that there is a network with no hidden units that computes the same function.

b. Repeat the calculation in part (a), but this time do it for a network with any number of hidden layers.

c. Suppose a network with one hidden layer and linear activation functions has n input and output nodes and h hidden nodes. What effect does the transformation in part (a)
to a network with no hidden layers have on the total number of weights? Discuss in particular the case h n.

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer

Step: 1 Unlock blur-text-image

Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock

Step: 3 Unlock

Students Have Also Explored These Related Artificial Intelligence Modern Questions!

Suppose you had a neural network with linear activation functions. That is , for each unit the output is some constant c times the weighted sum of the inputs. a . Assume that the network has one...

Suppose you had a neural network with linear activation functions. That is , for each unit the output is some constant c times the weighted sum of the inputs. Assume that the network has one hidden...

Suppose you had a neural network with linear activation functions. That is, for each unit the output is some constant times the weighted sum of the inputs. a. Assume that the network has one hidden...

Unfortunately, directly representing A + B + C + D + E where + represents XNOR with a simple multilayer neural network using linear activation functions is impossible, as explained before. However,...

NOTE: please solve it quickly (b) Consider the neural network model with 2 input layer neurons (1), 2 hidden layer neurons () and 1 output layer neuron (k) as shown in Figure 1 for Short-Term Load...

4. A. The neural network shown in the following figure is presented with the input pattern [0, 1] and target output 1. 0.3 0.6 0.4 -0.2 -0.1 Output -0.3 X2 0.1 0.4 0.5 Figure 4. Neural network...

1. slide 19 and 2.slide 20 Single (Hidden) Layer Neural Network zj=w0,j(1)+i=13xiwi,j(1),yk=w0,k(2)+j=1k=1,2,3,4.4g(zj)wj,k(2), Q1: For the perceptron, what are the model parameters to leam based on...

Answer all 1 . Which of the following is true about neural networks ? Group of answer choices Transfer function is the mathematical model for a biological neuronEach neuron can receive only one...

A perceptron is like a neural network that has no hidden layers and a single output unit with on e of the following activation functions. g(z)=1+ez1g(z)=max(0,z)g(z)={1ifz>01ifz0g(z)=tanh(z) Suppose...

Question 9 Order the following steps when setting up a Total Station over a point up to before centering the circular and long (plate) bubble. - 1. 2. 3. 4. 5. 6. Use the footscrews to re-center the...

The structure of the report or presentation for Part A shall be based on the following steps and the group's responses to the tasks shall be completed in the order that they appear below. 1. Cover...

Aircraft noise is so common at the Grand Canyon that in some areas it is audible almost _ _ _ _ _ percent of the time. 8 0 3 0 1 0 5 0

Evaluate each of the following. 54 36 4 + 2 2