(a) Suggest a network architecture appropriate for MNIST and explain why the cross- entropy cost function...
Fantastic news! We've Found the answer you've been seeking!
Question:
Transcribed Image Text:
(a) Suggest a network architecture appropriate for MNIST and explain why the cross- entropy cost function might be preferable to the mean-squared-error when the sigmoid activation function is used. (5 marks) (b) Explain the problem of overtraining a neural network and how it could be alleviated. How does MNIST address this problem? (5 marks) (c) Briefly explain what gradient descent means and how it relates to the cost or loss function. Explain what each of the following symbols represents and the relationship between then in gradient descent. w, and ac aw Vij ? (d) At the core of the backpropagation algorithm are the matrix formulae: ac = 8} ak awk 1-1 s = (a - y) o' (z) 8 = ((w+1) 8+1) o' (2) Briefly explain what each term means and which one in particular relates to backpropagation. (5 marks) Also, for a three layer network, write a Python code fragment which includes each of these formulae. (10 marks) (a) Suggest a network architecture appropriate for MNIST and explain why the cross- entropy cost function might be preferable to the mean-squared-error when the sigmoid activation function is used. (5 marks) (b) Explain the problem of overtraining a neural network and how it could be alleviated. How does MNIST address this problem? (5 marks) (c) Briefly explain what gradient descent means and how it relates to the cost or loss function. Explain what each of the following symbols represents and the relationship between then in gradient descent. w, and ac aw Vij ? (d) At the core of the backpropagation algorithm are the matrix formulae: ac = 8} ak awk 1-1 s = (a - y) o' (z) 8 = ((w+1) 8+1) o' (2) Briefly explain what each term means and which one in particular relates to backpropagation. (5 marks) Also, for a three layer network, write a Python code fragment which includes each of these formulae. (10 marks)
Expert Answer:
Answer rating: 100% (QA)
a For MNIST a straightforward and successful organization design could be a feedforward brain networ... View the full answer
Related Book For
Posted Date:
Students also viewed these programming questions
-
QUIZ... Let D be a poset and let f : D D be a monotone function. (i) Give the definition of the least pre-fixed point, fix (f), of f. Show that fix (f) is a fixed point of f. [5 marks] (ii) Show that...
-
Let A, B be sets. Define: (a) the Cartesian product (A B) (b) the set of relations R between A and B (c) the identity relation A on the set A [3 marks] Suppose S, T are relations between A and B, and...
-
What is the difference between an optimistic approach and a pessimistic approach to decision making under assumed uncertainty?
-
(CMA adapted) The Margro Corporation is an automotive supplier that uses automatic turning machines to manufacture precision parts from steel bars. Margro's inventory of raw steel averages $600,000....
-
What is a debenture, and how does it differ from other types of fixed-income securities, such as bonds or notes? 2. How do companies issue debentures to investors, and what are some of the key...
-
It is generally known that boys grow at an unusually fast rate between the ages of about 12 and 14. Following are heights, in inches, of 40 boys measured at age 12 and again at age 14. Can you...
-
Restate the following question component of the issue in a persuasive manner. A. "should the evidence be suppressed when . . . ?" In the case, the police failed to obtain a search warrant prior to...
-
Dantzler Corporation is a fast - growing supplier of office products. Analysts project the following free cash flows ( FCFs ) during the next 3 years, after which FCF is expected to grow at a...
-
You are an Examiner for the Refund Integrity Program in the GST/HST Audit Division of the Canada Revenue Agency (CRA). Using sophisticated analytical tools, you are able to identify GST/HST returns...
-
An investment promises an annual return of RM1,000 for 15 years. If the first annual return begins now, find the present value of the investment if the money is worth an interest of 6% compounded...
-
Discuss how data deduplication works in backup systems and its impact on storage efficiency. What are some potential drawbacks of deduplication, and how might they be mitigated ?
-
3x+1 1. Determine the approximate slope of the tangent to the curve f(x) = 2x+7 at x=-2, to one decimal place.
-
Describe the importance of application consistency in backup operations. How do modern backup systems ensure consistency, and what are the risks of a quiescence failure ?
-
Find lim 80426 (-3)+2 en-4
-
Discuss the importance of backup compliance auditing and reporting in demonstrating regulatory compliance and adherence to data protection standards. What audit trails and reporting mechanisms should...
-
Who owns the Bank of Canada? Select one: O a. private individuals O b. the Queen c. the chartered banks O d. the federal government of Canada
-
Find the intercepts and then graph the line. (a) 2x - 3y = 6 (b) 10 - 5x = 2y
-
The complex gas-phase reactions are elementary and carried out in a PFR with a heat exchanger. Pure A enters at a rate of 5 mol/min, a concentration of 0.2 mol/dm 3 , and temperature 300 K. The...
-
The enzymatic hydrolysis of starch was carried out with and without maltose and -dextrin added. (Adapted from S. Aiba, A. E. Humphrey, and N.F. Mills, Biochemical Engineering, New York: Academic...
-
How do the steps in the design of a CSTR differ from those of a CSTR or a PFR with pressure drop?
-
The audit procedures applied to accrued liabilities differ from those applied to accounts payable because a. Accrued liabilities balances are less material than accounts payable balances. b. Evidence...
-
Match each assertion to the related audit objective. Each assertion may be used once, more than once, or not at all. Audit objective 1. To determine whether the amount shown as invento- ries in the...
-
Audit procedures should be designed to accomplish specific audit objectives. Review the following inventory audit procedures and indicate which audit objectives are being accomplished and how. a....
Study smarter with the SolutionInn App