Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

(a) Suggest a network architecture appropriate for MNIST and explain why the crossentropy cost function might be preferable to the mean-squared-error when the sigmoid activation

image text in transcribed

(a) Suggest a network architecture appropriate for MNIST and explain why the crossentropy cost function might be preferable to the mean-squared-error when the sigmoid activation function is used. (5 marks) (b) Explain the problem of overtraining a neural network and how it could be alleviated. How does MNIST address this problem? (5 marks) (c) Briefly explain what gradient descent means and how it relates to the cost or loss function. Explain what each of the following symbols represents and the relationship between then in gradient descent. wijlandwijlC? (d) At the core of the backpropagation algorithm are the matrix formulae: wjklC=jlakl1L=(aLy)(zL)l=((wl+1)Tl+1)(zl) Briefly explain what each term means and which one in particular relates to backpropagation. Also, for a three layer network, write a Python code fragment which includes each of these formulae. (10 marks)

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Database Concepts

Authors: David M. Kroenke

1st Edition

0130086509, 978-0130086501

More Books

Students also viewed these Databases questions

Question

Question How are IRAs treated for state tax law purposes?

Answered: 1 week ago