Gathika: A Dynamic Query Distribution Mechanism For Complex Event Processing Systems

Complex Event Processing (CEP) is heavily used in real time systems where people are interested in extracting valuable information from event streams. In CEP systems, some event processing nodes can get overloaded due to event bursts, thus degrading the overall throughput of the whole system. Dynamic distribution of queries among nodes is required in such situations.This paper presents a dynamic query distribution mechanism that can be employed on distributed CEP systems. It is capable of optimally distributing queries across nodes of the distributed CEP system when adding new queries to the system, adding new processing nodes to the system, and when CPU and memory utilization of a node exceeds the threshold value. Evaluation of the system shows that proper execution of the algorithm helps to maintain the overall system performance amidst event bursts.