V$.$ Discuss why the notion of distance fails in high$-$dimensional spaces.

Q$2.$ Answer the following questions. $(5$ points each$)$

I. Describe the limitations of the closed$-$form solution of linear regression. List the alternative

solution for each limitation$.$

II$.$ What is the purpose of data Normalization? Which of the traditional Machine Learning models do

not need Normalization and why?

III. Consider a bag where there are $60$ identical items of which $10$ are red$-$colored, $20$ are green, and

$30$ are blue. A person peeks into the bag and estimates the number of red, green, and blue items as

$12,15,$ and $33$ respectively. What is the cross entropy between the estimated distribution of the

items and the actual distribution?