Research on Web information extraction based on spider algorithm and DOM thinking

The structure characteristics of the website is complicated, Web information structure is not fixed and not neat, so it is inefficient that the Web information is captured largely, the integration of Web information is very difficulty. Research Web information extraction technology, put forward and carry out a new method based on a spider algorithm and DOM thinking. Experimental results show that the method can extract information efficiently and accurately on the Web.