Answered step by step
Verified Expert Solution
Question
1 Approved Answer
Hello, below are the details for a LINEAR REGRESSION assignment. I would like to train 10 univariate linear regression models and return the best one.
Hello, below are the details for a LINEAR REGRESSION assignment. I would like to train 10 univariate linear regression models and return the best one. For the end, I also need to include a graph that plots the given data from the dataset in the library and the regression line. If you could also include the results of your answer. I am writing it in Python using COLAB. Any help is appreciated. Thank You.
Directions: For this assignment, you need to build a linear regression model from scratch. Below is a detailed instruction of what you may need to do. - Dataset Preparation - You need to load the dataset using sklearn.datasets. load_diabetes. After loading the dataset, randomly shuffle the dataset to split the dataset to train/dev/test sets. - Use the 70% of data for the train set, 15% for the dev set, and 15% for the test set - You need to make sure that the labels and features are still matching after shuffling the data. - You may want to use the random shuffle function provided by Numpy. - Univariate Linear Regression Development You need to implement a univariate linear regression model from scratch. - You need to use a gradient descent algorithm to solve the optimal parameters for the univariate linear regression model. - You need to implement the gradient descent algorithm from scratch. The dataset contains 10 features; however for a univariate linear regression model, you may only use one feature. Thus, to build the linear regression model, you need to decide which feature to you. There are three approaches you may use: - You may train 10 univariate linear regression models, one model for each feature, and select the one with the best performance on the dev set. - You may run a feature selection algorithm to select a feature. There are plenty of feature selection algorithms available. Feel free to search on the internet and use a method at your choice. - You may use PCA for dimension reduction to reduce the number of features to 1 . There are many python libraries that provide PCA algorithms you may use. In fact, scikit-learn also has a function. Feel free to search on the internet and choose one at your choice
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started