%0 Journal Article
%T 融合词频特性及邻接变化数的微博新词识别<br>Weibo new word recognition combining frequency characteristic and accessor variety
%A 周超
%A 严馨
%A 余正涛
%A 洪旭东
%A 线岩团&lt
%A br&gt
%A ZHOU Chao
%A YAN Xin
%A YU Zheng-tao
%A HONG Xu-dong
%A XIAN Yan-tuan
%J 山东大学学报（理学版）
%D 2015
%R 10.6040/j.issn.1671-9352.3.2014.284
%X 摘要： 大量的新词伴随着微博的快速发展而产生,这些新词具有传播速度快及与其他词组合方式灵活的特点,而且在进行分词处理时容易被切分为不同的字符串。提出了一种融合词频特性及邻接变化数的微博新词识别方法。该方法首先对大规模的微博语料进行分词,然后将在两停用词间的相邻字串两两组合,根据组合后的字串频率统计取得新词候选串,再通过组合成词规则进行筛选获得候选新词,最后通过词的邻接域变化特性去除垃圾串获得新词。利用该方法在COAE 2014评测任务上进行了新词的发现实验,准确率达到36.5%,取得了较好的成绩。<br>Abstract: Along with the rapid development of Weibo, a lot of new words have appeared. These words have characteristic that spread fast and flexible combination with other words. They are easy to be cut apart into different string in segmentation processing. Therefore a new word recognition method that combines word frequency characteristics and accessor variety was proposed. The first step was to segment the large scale Weibo sentences into words, and then combine the two adjacent strings between stop words. The new word candidate strings could be obtained according to the string frequency of the combination. After the filtration through the word formation rules, the candidate new words would be found. Finally, through the characteristics of the word accessor variety, the garbage string was removed to get the new words. Experiments of new word recognition on COAE 2014 task 3 show that the accuracy can reach 36.5% and this method has a good performance
%K 邻接变化数
%K 微博新词
%K 成词规则
%K 字串频率统计
%K &lt
%K br&gt
%K Weibo new words
%K string frequency statistics
%K accessor variety
%K word formation rules
%U http://lxbwk.njournal.sdu.edu.cn/CN/10.6040/j.issn.1671-9352.3.2014.284