By Topic

Scalable Clustering Using PACT Programming Model

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

4 Author(s)
Sharanjit Kaur ; Dept. of Comput. Sci., Univ. of Delhi, Delhi, India ; Dhriti Khanna ; Tripti Gupta ; Vasudha Bhatnagar

Recent spurt in research related to scalability of data mining algorithms can be attributed to advances in cloud computing technology, which enables data-intensive applications in distributed environment. Map-Reduce has been the most popular programming paradigm for developing applications in large scale distributed environments. In this paper we present design of a scalable clustering algorithm 'Exclusive and Complete Clustering using PACT Programming model' (ExCC-P) for recently developed Stratosphere system for cloud computing environment. This system supports novel model for programming in large scale distributed environments. Based on the concept of Parallelization Contracts, the PACT programming model is a generalization of Map-Reduce paradigm. PACT programs are complied by a PACT compiler and executed by Nephele execution engine of Stratosphere after optimizing data-flow graphs. The algorithm ExCC-P is proposed as a solution for incremental clustering of unbounded massive data sets, to be executed in Stratosphere environment. The algorithm discretizes data space into a conceptual grid and processes data in batches. After a batch is processed, the algorithm applies connected component analysis on the grid to deliver arbitrarily shaped clusters. Limited experimentation on this under-development system (Stratosphere) validated PACT programming model for the proposed algorithm.

Published in:

2012 IEEE 12th International Conference on Data Mining Workshops

Date of Conference:

10-10 Dec. 2012