Automatic detection of shared fragments model
共享片段自动检测模型

A model of automatic online detection of shared fragments was described including its architecture and implementation schemes. Besides, a scalable algorithm for detecting shared fragments was proposed. The online detection algorithm could run automatically in the model. The model took the Web pages that were more popular than others as detection objects, and could get a set of maximal shared fragments from a large collection of Web pages. Experimental results show that it not only provides veracity of detection but also improves the efficiency.