By Topic

An Anticipative Recursively-Adjusting Mechanism for redundant parallel file transfer in data grids

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

4 Author(s)
Ming-Feng Yang ; Dept. of Comput. Sci. & Inf. Eng., Tunghai Univ., Taichung ; Yao-Chun Chi ; Ming-Feng Yang ; Ching-Hsien Hsu

In data grids, co-allocation architectures were developed to enable parallel downloads of datasets from selected replica servers. As Internet is usually the underlying network of a grid, network bandwidth plays as the key factor affecting file transfers between clients and servers. In this paradigm, there are still some challenges which need to be solved, such as to reduce differences in finish times between selected replica servers; to avoid traffic congestion resulting from transferring the same blocks in different links among servers and clients; and to manage network performance variations among parallel transfers. In this paper, we propose the anticipative recursively-adjusting mechanism (ARAM) scheme to adjust the workloads on selected replica servers and handle unpredictable variations in network performance by those servers. Our algorithm is based on using the finish rates of previously assigned transfers to anticipate the bandwidth status for next section in order to adjust workloads, and to reduce file transfer times in grid environments. Our approach is useful in grid environments with unstable network link. It not only reduces idle time wasted waiting for the slowest server, but also decreases file transfer completion times.

Published in:

Computer Systems Architecture Conference, 2008. ACSAC 2008. 13th Asia-Pacific

Date of Conference:

4-6 Aug. 2008