High Performance Scientific Computing with C 4.3: Distributed Memory Parallelism with MPI

The video tutorial explores how to use MPI for distributed memory parallelism, allowing code to run across multiple machines. It demonstrates setting up a virtual MPI cluster using Docker and applying MPI to a Monte Carlo Pi estimator. The tutorial covers optimizing MPI code for better performance and distributing tasks across virtual machines. It concludes with a preview of using GPUs for scientific code acceleration.

How does the rank and size of a program affect its execution in MPI?

What advantages does MPI provide over OpenMP in parallel computing?

How can Docker be utilized to simulate a supercomputer for MPI applications?