Answered step by step
Verified Expert Solution
Question
1 Approved Answer
(a) Suggest a network architecture appropriate for MNIST and explain why the crossentropy cost function might be preferable to the mean-squared-error when the sigmoid activation
(a) Suggest a network architecture appropriate for MNIST and explain why the crossentropy cost function might be preferable to the mean-squared-error when the sigmoid activation function is used. (5 marks) (b) Explain the problem of overtraining a neural network and how it could be alleviated. How does MNIST address this problem? (5 marks) (c) Briefly explain what gradient descent means and how it relates to the cost or loss function. Explain what each of the following symbols represents and the relationship between then in gradient descent. wijlandwijlC? (d) At the core of the backpropagation algorithm are the matrix formulae: wjklC=jlakl1L=(aLy)(zL)l=((wl+1)Tl+1)(zl) Briefly explain what each term means and which one in particular relates to backpropagation. Also, for a three layer network, write a Python code fragment which includes each of these formulae. (10 marks)
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started