Design and Implementation of Web Hot-Topic Talk Mining Based on Scale-Free Network

Data mining of Web hot-topic talks is one of the important branches on the Web text mining. In traditional data mining system of the Web hot-topic talks, it is assumed that the importance of each Web page is equal. However, complex network composed of the Web hot-topic talks is not a homogeneous network because of having the scale-free characteristic on the Internet. So the assumption above is not reasonable for this network. In this paper the topology of the complex network is analyzed and shown that the network has the scale-free characteristic firstly. Then the mining system based on the scale-free topology is designed, and some main modules are introduced. The workflow of this system is presented, and the implementations of two core modules, which are the analysis module of sites' topology and the distributing proportion to these Web-pages, are proposed in detail. Finally, the merits and shortcomings of this system are concluded, and this paper is summarized