SPMD Performance Analysis with Parallel Computing of Matlab

Matlab Parallel Toolbox is an effective tool for developing parallel program under a multi-processor environment, in which SPMD is the key statement for single instruction multiple data parallel implementation. However, when using spmd to achieve parallel program, beginners may find that it can hardly improve the speedup of program, and is even worse than the serial one. In this paper, we analyze the matrix operation, for-loop control and the influence the computing scale has on the performance of SPMD, and explain why SPMD speedup is hard to be improved through plenty of experiments. Finally we propose effective methods using spmd to improve parallel program speedup and give sample code of joint histogram on image application.