By Topic

Performance Prediction for MPI Parallel Jobs

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

4 Author(s)
Weizhe Zhang ; Sch. of Comput. Sci. & Technol., Harbin Inst. of Technol., Harbin, China ; Tianyu Han ; Yuanjing Zhang ; Cheng, A.M.K.

Performance prediction of run time in the cluster is the foundation of efficient resource management and task scheduling. Considering the defects and limitations of traditional methods based on the history and modeling analysis, this paper proposes a new approach based on the Performance Skeleton. Through the use of the MPI library's PMPI interface, we can insert wrapper-functions to the source code, which can access all communication traces without changing the original program or affecting the operation of the original program. To merge these trace logs, we designed the trace log regularization and merging algorithm. For compressing circulatory traces, the most central and difficult problem, this paper converts it into a circular sub-string compression problem, and proposes an algorithm based on the suffix array. Its performance is better than the existing algorithms. To automatically reconstruct the Performance Skeleton, it solves the scalable problems of calculation and communication time. Experimental results show that these methods can accurately estimate the run time of computing jobs. The error is less than 3% for a homogeneous cluster.

Published in:

Cluster Computing Workshops (CLUSTER WORKSHOPS), 2012 IEEE International Conference on

Date of Conference:

24-28 Sept. 2012