Modeling Web Crawler Wrappers to Collect User Reviews on Shopping Mall with Various Hierarchical Tree Structure

Along with the increased number of Internet shopping mall users, high quantities of reviews on products are often found in many shopping malls. In order to extract effective information from those reviews, many studies on opinion mining have been actively performed. Due to the various type of structure of shopping malls, it is difficult to apply a single Web crawler on all the shopping malls, so proper Web crawler models need to be implemented for each shopping mall. The core technique of constructing the appropriate Web crawler is the Wrapper, and in this study, wrapper models for product reviewing Web crawlers are suggested, designed, and implemented for four large shopping malls.