Consider the neural network with two hidden layers shown in the following Figure to answer the next $8$ questions. The input layer consists of $3$ features x $=[\backslash$times $1,$ X$2,$ X$3],$ each hidden layer has two nodes and the output layer gives the probabilities g $=191,32193$; $94)$ over four classes $1,2,3$ and $4.$ The weight parameter on each arc is labeled on the figure. There are three sets of weights: a$,$ w$,.$

The weights before this pass are the following:

$$ Hidden layer $1$: $011=0\mathrm{.}5,$ a$12=0\mathrm{.}5,021=0\mathrm{.}7,$ a$22=0\mathrm{.}3,$ a$31=1,032=0.$

$$ Hidden layer $2$: w$11=0,$ w$12=1,$ w$21=0\mathrm{.}2,$ w$22=0\mathrm{.}8$

$$ Output layer: $312=1,$ B$23=0\mathrm{.}5,$ B$24=0\mathrm{.}5,$ all other Bjk $=0.$

Question $1.$

Perform forward propagation on the given data point with the given weights. What are the values of U$1,$ uz in the second hidden layer?

$=0\mathrm{.}1,42=0\mathrm{.}2$

$$ u$1=0\mathrm{.}2,22=0$

$0$ u$1=0\mathrm{.}04,$ u$2=0\mathrm{.}16$

$0$ u$1=0\mathrm{.}04,$ u$2=0\mathrm{.}06$