Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

2. Consider the following two-layer network. (1) X2) The weights and bias for X() is (5,-3) and 2, respectively. The weights and bias for


  

2. Consider the following two-layer network. (1) X2") The weights and bias for X() is (5,-3) and 2, respectively. The weights and bias for X() is (-2,6) and -1, respectively. The weights and bias for Y are (1,1) and 1, respectively. The activation function is ReLU for X1 () and X2 (1) and identity function for Y. We have two data points: (X11=1, X12=1, y1=5) and (X21=1, X22=-1, y2=8). (a) Calculate the prediction for two data points using the above network. Calculate the total square loss value. Show the details for your calculation. (b) Now we add a dropout with rate 0.5 to the first hidden layer. Assume X2 () is dropped when making the prediction for data point (X11=1, X12=1,y1=5) and X1() is dropped when making the prediction for data point (X21=1, X22=-1,y2=8). Calculate the prediction for two data points and the total square loss value. Show the details for your calculation.

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Introduction To Statistical Investigations

Authors: Beth L.Chance, George W.Cobb, Allan J.Rossman Nathan Tintle, Todd Swanson Soma Roy

1st Edition

1118172140, 978-1118172148

More Books

Students also viewed these Programming questions

Question

1. Eat lunch with a different group of students every day.

Answered: 1 week ago