$2.$ ETL $(50$ points$)$

Use Matillion $($what we reviewed in class$)$ to create an ETL pipeline.

This pipeline will start with the same data we used during our in$-$class demo:

$$ load$\_$etl$\_$s$3\_$salaries.csv file in the csc$8491$hw$2$ AWS S$3$ bucket

$$ the Employees$\_$Source table from the mysql$-$csc$8491-$csc$8491$etl.d$.$aivencloud.com MySQL server

Remember that the connection details for each of these are stored in Blackboard $($Week $4$ Slides and Readings$)$ and are shown in the week $4$ Zoom recording.

You will join these data sets together on their shared $$Id$$ attributes and insert only the Id$,$ LastName, and Salary data into a new table in the Matillion data warehouse $($the free Snowflake one they create for you$).$ The new table will have the name HW$2\_$Load.

This will require the same skills we demonstrated in class.

Once your pipeline is working, you will paste into this document:

$$ for each pipeline you created, a legible screenshot of the $$graph paper$$ designer window that shows your entire pipeline $($you can move things around if you need to make it more compact in order to be legible$)$ remember that you will need both an $$Orchestration$$ and a $$Transformation$$ pipeline to complete this task

$$ screenshots of what you see when you click on each of the steps in your pipeline

o this means a separate screenshot specific to each step

o the screenshot should capture step configuration details $($not necessarily all details because some might be out of view$)$

$$ a YAML export of the configuration for each pipeline $($look for the ellipsis to the right of each pipeline in the Pipelines view$)$