Communication Study and Implementation Analysis of Parallel Asynchronous Iterative Algorithms on Message Passing Architectures

The implementation of parallel asynchronous iterative algorithms on message passing architectures is considered. Several issues related to communication via message passing interfaces or libraries such as MPI-1, MPI-2, PVM or SHMEM are discussed in this survey paper. Practical implementations are proposed.