Design and Development of an Intelligent Network Crawler System

In this paper, the network crawler and data analysis system based on Spring Mvc framework is developed through the development of JAVA WEB. First, grab the specified data, for the analysis of television programs and single network television, real-time monitoring of the existing mainstream video sites, get detailed information of the designated program (director, actor, release time, playback volume, number of comments), and collect the data stored in the database for analysis and processing. Secondly, the analysis and processing of data. Through data analysis program, we can directly display the quantifiable information such as playback volume, commentary number, number of points and so on in the form of charts, providing reliable basis for data analysis, and making users predict future behavior more accurately.