Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

CoursHeroTranscribedText: Data Exploration and Multiple Linear Regression (MLR) using R1 The Boston Housing data set, part of the MASS package, records properties of 506 housing

CoursHeroTranscribedText: Data Exploration and Multiple Linear Regression (MLR) using R1 The "Boston Housing" data set, part of the MASS package, records properties of 506 housing zones in the Greater Boston area. For a description of the data (housing data and attribute information), visit https://archive.ics.uci.edu/ml/datasets/Housing. Typically one is interested in predicting MEDV (median home value) based on other attributes. 1. Generate box-plots of the LSTAT (% of lower status in the population) and MEDV (median home value) attributes and identify the cutoff values for outliers. Generate a scatterplot of MEDV against LSTAT; comment on how inclusion of the outliers would affect a predictive model of median home value as a function of % of lower status in the population. 2. Try to fit an MLR to this dataset, with MEDV as the dependent variable. MEDV has a somewhat longish tail and is not so Gaussian-like, so we will take a log transform, (use LMEDV = - log(MEDV) ), and then predict LMDEV instead. (You should convince yourself that this is a better idea by looking at the histograms and quantile plots to assess normality; however no need to submit such plots). Keep the firrst 300 records as a training set (call it Bostrain) which you will use to fit the model; the remaining 206 will be used as a test set (Bostest). Use only the following variables in your model: LMEDV = LSTAT + RM + CRIM + ZN + CHAS. 3. Report the coefficients obtained by your model. Would you drop any of the variables used in your model (based on the t-scores or p-values)? 4. Report the MSE obtained on Bostrain. How much does this increase when you score your model (i.e., predict) on Bostest? 5. (Bonus 1 point). Use the stepwise regression to reach your final model. Try different model section criteria (i.e., AIC, Cp, BIC, adj R^2, R^2) and see if you can come up with the same model even with the different criteria. Determine the best model if you get different models with different criteria? We will consider a model that gives the highest accuracy (in terms of MSE) in the test set as the best model. 1 You must use R to run regression although use of other software is also encouraged for verification of your answers

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Introduction to Real Analysis

Authors: Robert G. Bartle, Donald R. Sherbert

4th edition

471433314, 978-1118135853, 1118135857, 978-1118135860, 1118135865, 978-0471433316

More Books

Students also viewed these Mathematics questions

Question

explain how psychosocial risks can be prevented or managed;

Answered: 1 week ago