By Topic

Cost-Efficient Processing of Continuous Extreme Queries over Distributed Data Streams

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

4 Author(s)
Li Tian ; Sch. of Comput., Nat. Univ. of Defense Technol., Changsha ; Peng Zou ; Li Zhang ; Aiping Li

We address the problem of cost-efficient processing of continuous extreme queries (MAX or MIN) over distributed sliding window streams, and propose several methods for communication reduction and resource sharing among queries. Firstly, we develop an effective pruning technique to minimize the number of elements to be kept. It can be shown that on average only O(logN) key points need to be stored for exact answer of extreme query, where N is the number of points contained in the sliding window. Then we consider the distributed environment, where remote nodes delay the data transmission as late as possible, and adopt the pruning strategy to filter local stream tuples, which is quite efficient in communication reduction. An efficient algorithm called MCEQP is proposed in the coordinator node for continuously monitoring K queries with different sliding window widths, and the linklist-implemented instance of MCEQP can update all K results in O(M+K) time when a new tuple arrives, where M is the cardinality of key points set corresponding to the widest window. Theoretical analysis and experimental evidences show the efficiency of proposed approach both on storage/communication reduction and efficiency improvement.

Published in:

Web-Age Information Management, 2008. WAIM '08. The Ninth International Conference on

Date of Conference:

20-22 July 2008