Message passing
Message passing denotes the explicit exchange of data between processes in a distributed memory program. Most modern Fortran, C or C++ programs deploy MPI for the data exchange. To achieve high or even acceptable computational speed, distributed memory programs can place extreme demands on the communication network of an HPC system.