%0 Journal Article
%T Research on focused crawler based on Bayes classifier
基于贝叶斯分类器的主题爬虫研究*
%A ZOU Yong-bin
%A CHEN Xing-shu
%A WANG Wen-xian
%A
邹永斌
%A 陈兴蜀
%A 王文贤
%J 计算机应用研究
%D 2009
%I
%X Focused crawler is the core technology to implement a focused search engine. This paper made a research on focused crawler based on Bayes classifier, introduced the system architecture and key implementation of a focused crawler based on Bayes classifier. The key parts of the crawler include URL queue, crawling history, page downloader and page analyzer. This paper focused on the page ranking algorithm based on Bayes classifier.Used an improved TF-IDF algorithm to extract the characteristics of the page content, and adopted Bayes classifier to compute the page rank. The experiment results show that Bayes classifier is a better choice than PageRank algorithm to implement a focused crawler, under the condition of large network of resources.
%K Bayes
%K classifier
%K focused crawler
%K page ranking
贝叶斯
%K 分类器
%K 主题爬虫
%K 主题相关度
%U http://www.alljournals.cn/get_abstract_url.aspx?pcid=5B3AB970F71A803DEACDC0559115BFCF0A068CD97DD29835&cid=8240383F08CE46C8B05036380D75B607&jid=A9D9BE08CDC44144BE8B5685705D3AED&aid=FC464D95E2C53AC3D0F553423BFFAE31&yid=DE12191FBD62783C&vid=96C778EE049EE47D&iid=9CF7A0430CBB2DFD&sid=55BF33EFF67C392C&eid=18AF395CEEC3549B&journal_id=1001-3695&journal_name=计算机应用研究&referenced_num=0&reference_num=10