Caching and Archiving in Distributed System for Effective Information Collection and Analysis

The resource optimization method in distributed system of data collection and analysis is proposed by reducing system traffic due to caching and load distribution among system parts depending on a type of the collected data. Reducing the traffic by caching is a part of “local server” functionality that does not send data if absolute difference with previously sent data is lower than some configured constant. Load distribution is provided by dividing the messages in three types: alarm, cached, and simple data, where different types of messages have different destination paths and processing scenarios. Archiving on a “local server” for sending the cached data is used in cases when the accurate data are needed.