Research on Black Hat SEO Behaviour Measurement

In order to quickly improve the ranking, black hat SEO came into being. Its necessary to investigate black hat SEO. The research is mainly divided into three functional modules: pre-filtering, page classification and content extraction module. We improve the edit distance algorithm to obtain black hat SEO URLs, and then new black hat SEO pages are discovered and detected, such as multi port, multi IP, static parasite and dynamic parasite. We provide an improved TF-IDF algorithm to extract tweaked black words from black hat web pages. After several rounds of expansion, 31257 contact information, 115845 black words and 588941 black hat SEO URLs were obtained. Finally, the contact information and domain distribution were measured.