A Review on Web Scrapping and its Applications

Internet grants a wide scope of facts and data source established by humans. Though, it shall consist of an enormous assortment of dissimilar and ailing organized data, challenging in collection in a physical means and problematical for its usage in mechanical processes. Since the recent past, procedures along-with various outfits have been developed to permit data gathering and alteration into organized information to be accomplished by B2C and B2B systems. This paper will focus on various aspects of web scraping, beginning with the basic introduction and a brief discussion on various software's and tools for web scrapping. We had also explained the process of web scraping with an elaboration on the various types of web scraping techniques and finally concluded with the pros and cons of web scraping and an in detail description on the various fields where it can be applied. The opportunities taking an advantage of these data are numerous which shall include expanses concerning Open Government Data, Big Data, Business Intelligence, aggregators and comparators, development of new applications and mashups amongst formers.