By Topic

Self-Acting Load Balancing with Parallel Sub File Migration for Parallel File System

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

5 Author(s)
Bin Dong ; Sch. Of Comput. Sci. & Eng., Beihang Univ., Beijing, China ; Xiuqiao Li ; Limin Xiao ; Li Ruan
more authors

With number of I/O servers increasing, the load imbalance among them becomes an emerging challenge in using high-end computing system effectively. But most of contemporary file systems like PVFS2 and Lustre lack load balancing to optimize parallel I/O performance when facing large number of I/O servers. To address this problem, this paper proposes self-acting load balancing for parallel file systems. The proposed self-acting load balancing builds on dynamic file migration, and borrows the ideas from intelligent computing to enable automatic load balancing. Furthermore, in order to support promising scalability, the self-acting load balancing is fundamentally based on distributed architecture, which also permits parallel file migrations to accelerate balancing progress. By taking PVFS2 as basic platform, we implement the self-acting load balancing, and the experiments show that PVFS2 with self-acting load balancing can reduce the average response time and improve performance of parallel I/O obviously compared with original PVFS2.

Published in:

Computational Science and Optimization (CSO), 2010 Third International Joint Conference on  (Volume:2 )

Date of Conference:

28-31 May 2010