Code optimization:

Mention some techniques one can use to make the code more efficient. Why are operations in NumPy faster than operations in pure Python? What should one do before starting to optimize the code? What is the difference between I/O bounded and CPU bounded problems? What does it mean to run code in parallel? What kind of library can we use if we want to parallelize our code in Python?