Answered step by step
Verified Expert Solution
Question
1 Approved Answer
Use the scikit learn library for all the models if possible Using the Auto data set 6 . Alter the threshold for classifying a Low
Use the scikit learn library for all the models if possible
Using the Auto data set
Alter the threshold for classifying a Low to and report the changes in the test performance metrics from those reported in Qn
Find the optimal threshold by drawing the ROC curve. Change the threshold to the optimal value you found from the ROC curve and report the changes in the test performance metrics from those reported in Qn
Fit a Nave Bayes model to the training data to predict mpghighlow using all the other featuresvariables except mpg year, origin, and name. Predict the mpghighlow using the test dataset. Plot the ROC curve and report the best threshold on the ROC curve plot. Report the AUC on the curve plot as well. Report the accuracy, precision, recall, specificity and F score.
Fit a KNN model to the training data to predict mpghighlow using all the other featuresvariables except mpg year, origin, and name. Use a grid search between and to find the best value of k Report the accuracy, precision, recall, specificity, F score and AUC.
Fit a LDA model to the training data to predict mpghighlow using all the other featuresvariables except mpg year, origin, and name. Report the accuracy, precision, recall, specificity and F score.
Summarize the performance of the all the above models by creating a dataframe with columns ModelName, Accuracy, Precision, Recall, Specificity, F Score. The data frame should contain one row for each model you built above with each of the columns filled in with the appropriate metric. Print out the dataframe. Which model performed the best from an accuracy point of view and which model performed best from a recall point of view without adjusting for the threshold?
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started