Design and Implementation of Information Subscription System Based on Intelligent Crawler

With the continuous growth of data volume in the information age, it is becoming more and more difficult for people to obtain information they care about. The traditional way of manually collecting information from such massive data is inconvenient and inefficient. In order to solve this problem, we design an web information subscription system based on intelligent crawler. In this paper, the first section introduces the design of the system, which includes the two confirmations to determine the specific monitoring area, the original xpath-based information positioning and block method, the task management based on apscheduler and so on. The second section introduces the implementation of the system, which included the process of how to operate the system. The third hows the running interface and results of the system. And finally the experiments show that the system can help users quickly obtain useful web information.