By Topic

Double-layer Scheduling Strategy of Load Balancing in Scientific Workflow

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Yan Ma ; Sch. of Comput. Sci. & Technol., Shandong Univ., Jinan, China ; Bin Gong

Complicated method and technology have been introduced into business workflow to solve their cooperation and load balancing. However, as combination of data management and flow management, scientific workflow's load balancing is less researched. So the phenomena of conflicting scheduling and load unbalance often occur. In this paper, we analyze functional framework and load consumption of scientific workflow engine in detail, and then introduce the load models of workflow application, workflow runtime engine and grid node. More importantly, utility function quantifying various loads and performance is introduced to lay foundation for engine selection and task scheduling. The collection and evaluation of real-time status are implemented by monitor and high-layer planner. Considering load balancing of both scientific workflow engine and grid node, we propose a double-layer scheduling algorithm based on performance model. Results from experiments demonstrate that our proposed models and double-layer scheduling algorithm can well avoid load unbalancing and conflicting scheduling in engine and grid node. Moreover, completion time of scientific workflow application can reduce greatly owning to full and even utilization of engine and grid node.

Published in:

Parallel and Distributed Systems (ICPADS), 2009 15th International Conference on

Date of Conference:

8-11 Dec. 2009