%0 Journal Article %T AUTOMATIC SEGMENTATION OF CHINESE USING OVERLAYING AMBIGUITY EXAMINING METHOD AND STATISTICS LANGUAGE MODEL
利用覆盖歧义检测法和统计语言模型进行汉语自动分词 %A Wang Xianfang %A Du Limin %A
王显芳 %A 杜利民 %J 电子与信息学报 %D 2003 %I %X In this paper, the question of Chinese automatic segmentation is discussed using overlaying ambiguity examining method and statistics language model. The multi-time iterative method is applied to train language model, which can produce a better model. The process of training language model is described in detail. The result shows that the perplexity of language model is reduced. The accuracy of segmentation changes with different language model and the reason is analyzed. %K Statistics language model %K Overlaying ambiguity examining method %K Automatic segmentation
覆盖歧义检测法 %K 统计语言模型 %K 汉语 %K 自动分词 %K 切分正确率 %U http://www.alljournals.cn/get_abstract_url.aspx?pcid=5B3AB970F71A803DEACDC0559115BFCF0A068CD97DD29835&cid=1319827C0C74AAE8D654BEA21B7F54D3&jid=EFC0377B03BD8D0EF4BBB548AC5F739A&aid=CF23CB0E0746EEF0&yid=D43C4A19B2EE3C0A&vid=C5154311167311FE&iid=9CF7A0430CBB2DFD&sid=C4690645D4CCDCE7&eid=778972EBEFCE1267&journal_id=1009-5896&journal_name=电子与信息学报&referenced_num=6&reference_num=10