Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Use Matillion to do the below homework. Please answer it correctly. Thanks 1 . ETL ( 5 0 points ) Use Matillion ( what we

Use Matillion to do the below homework. Please answer it correctly. Thanks
1. ETL (50 points)
Use Matillion (what we reviewed in class) to create an ETL pipeline.
This pipeline will start with the same data we used during our in-class demo:
load_etl_s3_salaries.csv file in the csc8491hw2 AWS S3 bucket
the Employees_Source table from the mysql-csc8491-csc8491etl.d.aivencloud.com MySQL server
Remember that the connection details for each of these are stored in Blackboard (Week 4 Slides and Readings) and are shown in the week 4 Zoom recording.
You will join these data sets together on their shared Id attributes and insert only the Id, LastName, and Salary data into a new table in the Matillion data warehouse (the free Snowflake one they create for you). The new table will have the name HW2_Load.
This will require the same skills we demonstrated in class.
Once your pipeline is working, you will paste into this document:
for each pipeline you created, a legible screenshot of the graph paper designer window that shows your entire pipeline (you can move things around if you need to make it more compact in order to be legible) remember that you will need both an Orchestration and a Transformation pipeline to complete this task
screenshots of what you see when you click on each of the steps in your pipeline
o this means a separate screenshot specific to each step
o the screenshot should capture step configuration details (not necessarily all details because some might be out of view)
a YAML export of the configuration for each pipeline (look for the ellipsis to the right of each pipeline in the Pipelines view)

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Database Systems A Practical Approach To Design Implementation And Management

Authors: THOMAS CONNOLLY

6th Edition

9353438918, 978-9353438913

More Books

Students also viewed these Databases questions

Question

=+ How well do you think you could do your job?

Answered: 1 week ago