By Topic

Dynamic Co-allocation Scheme for Parallel Data Transfer in Grid Environment

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

3 Author(s)
R. S. Bhuvaneswaran ; Nagoya Institute of Technology, Japan ; Yoshiaki Katayama ; Naohisa Takahashi

The large sized data sets are replicated in more than one site for the better availability to the nodes in a grid. Downloading the dataset from these replicated locations have practical difficulties, due to network traffic, congestion, frequent change-in performance of the servers, etc. In order to speed up the download, complex server selection techniques, network and server loads are used. However, consistent performance is not guaranteed due to the shared nature of network links of the load on them, which can vary unpredictably. Hence, we find interest in a co-allocated download model, which enables parallel download of replicated data from multiple servers. In this paper, we proposed a dynamic co-allocation scheme for parallel data transfer in grid environment, which copes up with highly inconsistent network performances of the servers. We have developed an algorithm using circular queue, with which, the data transfer tasks are allocated onto the servers in duplication. Our scheme is highly fault tolerant one, in other words, the process of data transfer will neither be interrupted nor paralyzed, even when the link to servers under consideration is broken or idleness of the servers, whereas, none of the existing mechanisms consider the situation. We used Globus toolkit for our framework and utilized the partial copy feature of GridFTP. We compared our scheme with the existing schemes and the preliminary results show notable improvement in overall completion time of data transfer.

Published in:

2005 First International Conference on Semantics, Knowledge and Grid

Date of Conference:

27-29 Nov. 2005