By Topic

Addressing Data-Intensive Computing Problems with the Use of MapReduce on Heterogeneous Environments as Desktop Grid on Slow Links

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

4 Author(s)
Julio C. S. Anjos ; Inst. de Inf., UFRGS, Porto Alegre, Brazil ; Wagner Kolber ; Claudio R. Geyer ; Luciana B. Arantes

The emergence of data volumes in the order of petabytes creates the need to develop new solutions that make possible the processing of data through the use of intensive computing systems, as MapReduce. MapReduce is a programming framework where the programmer is abstracted from the parallelization process. However, this model is optimized primarily in large clusters and it has a low performance on heterogeneous environments, with computational capacity machines different. The motivation of this work is to apply the data-intensive computing heterogeneous environments as desktop grid with use MapReduce model. Due to deficiencies of the MapReduce model in heterogeneous environments it was proposed the MR-A++: a MapReduce with algorithms adapted to heterogeneous environments. The MR-A++ model creates a training task to gather information prior to the distribution of data. Therefore the information will be used to manager the system. The small delay introduced in phase of setup of computing is compensated with the adequacy of heterogeneous environment through computational capacity of the machines. So the performance gains can be greater than 70% at 10 Mbps.

Published in:

Computer Systems (WSCAD-SSC), 2012 13th Symposium on

Date of Conference:

17-19 Oct. 2012