Automatic Template Detection for Structured Web Pages

Similar Web pages of Web sites on the World Wide Web are usually encoded from an underlying structured source, and generated dynamically from a pre-defined template, such as books' information pages in Amazon.com. By giving a set of Web pages from a common Website, it is possible to extract the template by analyzing common patterns between the Web pages. In our work, we developed the CF-EXALG (collaborative finer-EXALG), based on EXALG, to decompose Web pages and finding their common structures. In our system, templates that are used to generate Web pages can be discovered automatically and stored in XML format. Hence, data encoded in Web pages can be easily extracted and the template can be stored for future manipulation. In our preliminary experiments, CF-EXALG has shown to be more accurate and efficient when compared with other similar systems