A Time Series Clustering Method for Network Big Data

In the era of big data, network data increase rapidly in a distributed manner, giving birth to the network big data. Network big data with the extra features such as distributed and decentralized data collection and storage, distributed and parallel data processing, more complex and evolving relationships among data, and heterogeneous data representation, pose opportunities together with challenges to the traditional network analysis algorithms. A hopeful solution is combining machine learning techniques with network big data analysis. In this paper, we proposed a novel time series clustering method which effectively combines machine learning techniques with network big data analysis for fault diagnosis task based on network logs. Verification experimental results on classic HDFS dataset demonstrate the outstanding performance of the proposed method.