|
A Methodology for Template Extraction from Heterogeneous Web PagesKeywords: MinHash , Minimum Description Length (MDL) , parsing. Abstract: The World Wide Web is a vast and most useful collection of information. To achieve high productivity in publishing the web pages are automatically evaluated using common templates with contents. The templates are considered harmful because they compromise the relevance judgement of many web information retrieval and web mining methods such as clustering and classification and badly impact the performance and resources of tools that processes the web pages. Thus, the template detection techniques have received a lot of attention to improve the performance of search engines, clustering and classification of web documents. In this paper, we are presenting the approach to detect and extract the templates from heterogeneous web documents and cluster them into different group. The pages belong to each group should possess the same structure .This saves thetime to find out best templates from a large number of web document and also saves the memory which is required to find out the best template structure.
|