Answered step by step
Verified Expert Solution
Question
1 Approved Answer
10 4. a) Create a neural network with only one hidden layer (of any number of units) that implements (AV-B )(CVD). Draw your network, and
10 4. a) Create a neural network with only one hidden layer (of any number of units) that implements (AV-B )(CVD). Draw your network, and show all weights of each unit. b) Figure 2 below is a small convolutional neural network that converts a 13x13 image into 4 output values. The network has the following layers/operations from input to output: convolution with 3 filters, max pooling, ReLU, and finally a fully-connected layer. For this network we will not be using any bias/o set parameters (b). - 13x13 3010x10 365x5 4x1 PP ! ---- D Convolution Max Pooling Fully- 3 Filters 4x4 Connected Stride 1 Stride 2 Figure 2: An example CNN Answer the followings: i. How many weights in the convolutional layer do we need to learn? ii. How many ReLU operations are performed on the forward pass? iii. How many weights do we need to learn for the entire network? iv. What is the disadvantage of a fully-connected neural network compared to a convolutional neural network with the same size layers? c) What is vanishing gradient problem? How do you solve this
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started