Question
Option #1: Your Portfolio Project consists of two items, a lessons learned reflection report and a database design and analysis project. Lessons Learned and Reflection
Option #1:
Your Portfolio Project consists of two items, a lessons learned reflection report and a database design and analysis project.
Lessons Learned and Reflection
Write a 2- to 3-page summary that outlines the lessons you learned in this database class. Reflect on how these lessons can be applied toward more effective database management and reporting.
Database Design and Analysis
Use the Accidents_2016.csv file below to implement the following steps for your database project.
- Create a MySQL schema named accidents.
- Within the accidents schema, create a table named accidents_2016 with the following columns:
- accident_index as a varchar(13),
- accident_severity as an int
- Within the accidents schema, create a table named vehicles_2016 with the following columns:
- accident_index as a varchar(13),
- vehicle_type as a varchar(10)
- Within the accidents schema, create a table named vehicle_type with the following columns:
- vcode int,
- vtype as a varchar(100)
- Next, you will load the data for the three tables.
- Load the accidents data. Note that @dummy is a placeholder for a column in the .csv file that you want to ignore during the load.
load data local infile '\\data\\Accidents_2016.csv' into table accidents_2016 fields terminated by ',' enclosed by '"' lines terminated by ' ' ignore 1 lines (@col1, @dummy, @dummy, @dummy, @dummy, @dummy, @col2 ,@dummy, @dummy, @dummy, @dummy, @dummy ,@dummy, @dummy, @dummy, @dummy, @dummy ,@dummy, @dummy, @dummy, @dummy, @dummy ,@dummy, @dummy, @dummy, @dummy, @dummy ,@dummy, @dummy, @dummy, @dummy, @dummy ) set accident_index=@col1,accident_severity=@col2;
- Load the vehicle data.
load data local infile '\\data\\Vehicles_2016.csv' into table vehicles_2016 fields terminated by ',' enclosed by '"' lines terminated by ' ' ignore 1 lines (@col1, @dummy, @dummy, @col2 ,@dummy, @dummy, @dummy, @dummy, @dummy ,@dummy, @dummy, @dummy, @dummy, @dummy ,@dummy, @dummy, @dummy, @dummy, @dummy ,@dummy, @dummy, @dummy, @dummy, @dummy ) set accident_index=@col1,vehicle_type=@col2;
- Load the vehicle type data.
load data local infile '\\data\\vehicle_type.csv' into table vehicle_type fields terminated by ',' enclosed by '"' lines terminated by ' ' ignore 1 lines
- After the data are loaded, you will perform the analysis. First, find the average accident severity and the number of accidents for vehicles of type motorcycle. Note the performance of your query. Your query may run so slowly that MySQL aborts running completing.
- Improve Query Performance
- Look at the explain tool output and save the results to a graphic file.
- From the explain results, how many rows have to be read per join?
- Add an index named accident_index of type index" on the accident_index
- column in the accidents_2016 table and another index named accident_index of type index on the vehicles_2106 table.
alter table accidents_2016 add index accident_index (accident_index asc);
alter table vehicles_2016 add index accident_index (accident_index asc);
After adding the indices, rerun the query explanation tool and determine the number of rows to be read per join.
- Find the median accident severity.
MySQL does not have a median function so to find the median accident severity, you will have to write a Python script.
- You'll need to install Python and the PyMySQL module.
- Install Python version 2.7 or 3.4 from www.python.org.
To install the PyMySQL module, run the following command in a Windows command prompt after Python has been installed:
python -m pip install --index-url=https://pypi.python.org/simple/ --trusted-host pypi.python.org PyMySQL
b) Create an accident median table
create table accident_medians ( vtype varchar(100), severity int );
- Run the following Python script:
import pymysql myConnection = pymysql.connect(host='localhost', user='****', passwd='****', db='accidents') cur = myConnection.cursor() cur.execute('SELECT vtype FROM vehicle_type WHERE vtype LIKE "%otorcycle%";') cycleList = cur.fetchall() selectSQL = (''' SELECT t.vtype, a.accident_severity FROM accidents_2016 AS a JOIN vehicles_2016 AS v ON a.accident_index = v.Accident_Index JOIN vehicle_type AS t ON v.Vehicle_Type = t.vcode WHERE t.vtype LIKE %s ORDER BY a.accident_severity;''') insertSQL = ('''INSERT INTO accident_medians VALUES (%s, %s);''') for cycle in cycleList: cur.execute(selectSQL,cycle[0]) accidents = cur.fetchall() quotient, remainder = divmod(len(accidents),2) if remainder: med_sev = accidents[quotient][1] else: med_sev = (accidents[quotient][1] + accidents[quotient+2][1])/2 print('Finding median for',cycle[0]) cur.execute(insertSQL,(cycle[0],med_sev)) myConnection.commit() myConnection.close()
Write each query you used in Steps 1 8 in a text file. If a query produced a result set, the list then first ten rows of each row set after the query. Bundle your lessons learned report, your queries and your query results text file, and your MySQL query explanations from both before and after adding table indexes into a single zip file and submit that zip file as your final portfolio.
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started