Answered step by step
Verified Expert Solution
Question
1 Approved Answer
1 . 1 One of the requirements for training a regular feedforward ANN is to normalize the desired outputs in the training data so that
One of the requirements for training a regular feedforward ANN is to normalize the desired outputs in the training data so that they lie within the output range of the activation functions either Ingistic or tanh of the output neurons. Let be the output range of such an activation function. Then, in the normalization process, you will map the domain of the desired output into a region a small positive number, because
a mapping exactly into may be unsafe due to the limitations of machine calculation accuracy which might put certain values below or above the actual range
this is redundant and may be set to zero
c When the desired outputs become close to either of the bounds the derivative of the activation function which plays a crucial role in transmitting the error upstream becomes vanishingly small leading to inefficient training
the desired outputs serve as "guides" for the predicted outputs and pull the latter towards themselves during the training process by modulation of weights As the predicted outputs shift towards the desired ones, If the latter are very close to the range bounds, the derivatives of the output activation function that generates the predicted outputs tend towards zero, limiting the progress of training.
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started