Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

a) Construct a DataFrame from a file read of the data set. b) Use vector assembler ( or manually) to transform the X1, X2 into

a) Construct a DataFrame from a file read of the data set.

b) Use vector assembler ( or manually) to transform the X1, X2 into Spark vectors

c) Prepare your DataFrame for a Spark regression algorithm

c) Run the Spark Linear regression algorithm

d) Compare with the Scala code == are they the same??

e) SSE=?

f) SST =

g)SSR =

h) r =

I) r2 =

g) RMSE =

Data Set

d1,2,3,15

d2,2,5,16

d3,4,4,15

d4,4,7,10

d5,5,5,13

d6,5,8,9

d7,5,9,8

d8,6,8,7

d9,7,7,8

d10,7,10,5

d11,8,11,4

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Database In Depth Relational Theory For Practitioners

Authors: C.J. Date

1st Edition

0596100124, 978-0596100124

More Books

Students also viewed these Databases questions