1. How can two GPU threads communicate through shared memory?

2. Which technological development of the last decade is chiefly responsible for the current practicality of parallel computers? Which technological development is chiefly responsible for distributed computing? Explain your answers

3. Distributed parallel computing systems typically consist of processing units that are connected together using a standard LAN technology (i.e. Ethernet), whereas in traditional parallel computing systems the processing elements are typically connectedtogether using some sort of internal data busConcentrating only on th communication between the processing elements give one advantage and one disadvantage of each approach. Justify your answers.

4. MPI was characterized as SPMD (Single Program Multiple Data) computing. What is

SPMD computing and how is it different from the SIMD computing?