%0 Journal Article
%T An Algorithm for Detecting Duplicated Chinese Web News Based on Suffix Tree
基于后缀树的中文新闻重复网页识别算法
%A Qian Aibing Jiang Lan
%A
钱爱兵
%A 江岚
%J 现代图书情报技术
%D 2008
%I
%X In view of the shortcomings of traditional methods detecting duplicated Chinese Web news,this paper proposes the suffix tree as the basic data structure,and then designs an algorithm for detecting duplicated Chinese Web news according to the title and published date of news.This algorithm is based on Ukkonen algorithm and Matching Statistics algorithm and optimizes the realization.Experiments show that the proposed algorithm is an effective solution to detect the duplicated Chinese Web news,and it can be generalized to measure the similarity of strings.
%K Suffix tree Duplicated Web page Ukkonen algorithm Matching statistics algorithm
后缀树
%K 重复网页
%K Ukkonen算法
%K 匹配统计算法
%U http://www.alljournals.cn/get_abstract_url.aspx?pcid=B5EDD921F3D863E289B22F36E70174A7007B5F5E43D63598017D41BB67247657&cid=E46382710BF131B2&jid=24AADBCD0D5373C73F37F78D10E2F717&aid=7574901B556DDC3EFFE42A8C91F99747&yid=67289AFF6305E306&vid=B91E8C6D6FE990DB&iid=38B194292C032A66&sid=E514EE58E0E50ECF&eid=1D0FA33DA02ABACD&journal_id=1003-3513&journal_name=现代图书情报技术&referenced_num=1&reference_num=17