By Topic

DIAO: A Scheme of Cooperative Data Distribution for Grid-Enabled Data Analysis Applications

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Tongcheng Guo ; Dept. of Comput. Sci., Univ. of Warwick, Coventry ; Jarvis, S.A.

A three-tier data distribution framework is proposed for grid-enabled data analysis applications. This framework is based on existing resource reservation services: the analytical tasks which this framework serves, and their input data, are assigned by an existing performance-aware scheduling system to computational hosts termed 'calculators'. A so-called 'guider' organizes the data delivery from the source server to the 'coordinators', and every coordinator schedules the data propagation from itself to all its calculators. This scheme, which we call DIAO, is peer-to-peer (P2P), in that after downloading a data item, a host may behave as its server. Theoretical modeling reveals that the duration of data distribution depends on the effective utilization of the bottleneck resource in the overlay, and we develop three heuristics to minimize this duration, subject to the available resources. The ability of DIAO to exploit limited resources is demonstrated through simulation.

Published in:

Computing in the Global Information Technology, 2008. ICCGI '08. The Third International Multi-Conference on

Date of Conference:

July 27 2008-Aug. 1 2008