Question
Part 1: Description: You will create processes, run processes in parallel, and pass information between processes. The data to be processed are lines of CSV
Part 1: Description: You will create processes, run processes in parallel, and pass information between processes. The data to be processed are lines of CSV separated values, we wish to sort these. 1. Get one of these data sets: http://earthquake.usgs.gov/earthquakes/feed/v1.0/csv.php (all quakes last 30 days) or http://www-odi.nhtsa.dot.gov/downloads/flatfiles.cfm and get the FLAT_RCL file (zip) which are all vehicle recalls in the US (the RCL.txt is the meta-data (schema) description of the data) or https://www.maxmind.com/en/free-world-cities-database (or allCountries.zip at http://download.geonames.org/export/dump/) Which contain cities names, location, and other information. If you sort the earthquake data, sort by latitude, in ascending order, if you sort the recalls sort by year of recall and manufacturer (first year, then manufacture name), if you sort cities sort by latitude then longitude. 2. Either: sort by hand, or write a two loop (bubble or insertion) sort program to sort the data. 3. Instrument your program (time it). 4. Create a program that will, in turn, run multiple processes concurrently using fork( ) and exec( ) (there are several variants of exec (execl, execv, etc.) Please do not use threads (yet). 5. Do the sort, again, in parallel for 2 concurrent processes, then 4, and 10 processes. 6. Instrument those sorts (above). 7. (?) How will you pass data (parts of the array) to each process (IPC)? (Files, pipes, shared memory, message queues?) 8. You may (not required) to use a menu to select number of processes, size of data, etc. Part 2: Description: You will create a process and threads, run in parallel, and pass information between threads. You will use synchronization operations to avoid overwriting shared resources. As in Assignment above: 1. Use the same data set, as assignment 2. 2. Either: sort by hand, or write a two loop (bubble or insertion) sort program to sort the numbers in ascending order. 3. Instrument your program (time it). 4. Create a program that will, in turn, run multiple threads concurrently using a kernel level threading system. (there are several options: Pthreads, Java, C/C++) 5. Do the sort, again, in parallel for 2 concurrent threads, then 4, and 10 threads. 6. Instrument those sorts (above). 7. (?) How will you pass data (parts of the array) to each thread? (How will you synchronize sharing resources such as memory?) 8. You may (not required) to use a menu to select number of threads, size of data, etc. Hint: Lawrence Livermore Lab thread tutorial: https://computing.llnl.gov/tutorials/pthreads/ includes thread creation, management, and using mutexes
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started