INTAP: Integrated Network Traffic Analysis Pipeline for LAN Monitoring System

Network security has become more important at present, due to an increase of cyber threats. One of the methods to protect our local area network from cyberattacks is a network monitoring system. It can capture traffic flowing in a network. However, the analysis of data from such network monitoring system is challenging, because it generates a large amount of data. Thanks to many tools developed to manage and process big data, we can solve that difficulty. In this paper, we present our design of the data analysis pipeline called Integrated Network Traffic Analysis Pipeline (INTAP) to overcome the challenges by the integration of the workflow management system, the distributed computing framework, and the data visualization tool. The analysis result with the network traffic data is presented in order to demonstrate the pipeline. The data source is our network monitoring system which is capturing network traffic from local area networks in the real world.