|
|
- 2016
不同语种及非言语情感声音的ERP研究
|
Abstract:
事件相关电位（ERP）技术是一种研究人脑对声音运行机制的有效方法。该文从语言种类出发，研究语义理解程度在情感语音感知中是否存在显著性影响；从言语和非言语角度出发，研究言语是否对情感声音感知存在影响。实验中，首先采用端点检测法对声音信号进行预处理，使它的起始位置和内容在时间进程上基本一致，便于ERP波形的叠加；再根据实验设计进行ERP实验。实验结果发现：在ERP波形距离起始点200 ms左右出现在颞区的负走向波形可能与韵律感知和语义理解相关。根据该波形的潜伏期及波幅推测，人脑对熟悉的情感语音更具有敏感性，且对非言语情感声音处理的时间进程相对较快。
Abstract：The event-related potential (ERP) is an effective method to study the brain mechanism of voice processing. This investigation studies how semantic understanding affects the emotional voice during speech and how speech influences the emotional voice for speech and non-speech utterances. In the tests, the audio signals are preprocessed using the endpoint detection technique to synchronize the ERP starting position with its corresponding signal content to enable superposition of the ERP waveforms. The ERP tests show that the negative waveform at around 200 ms in the temporal region may be associated with the prosody perception and the semantic understanding. In addition, the latency and amplitude results suggest that the brain is more sensitive to native emotional language than foreign emotional language and that the brain more quickly processes emotional non-speech utterances than emotional speech.
| [1] | Paulmann S, Pell M D, Kotz S A. How aging affects the recognition of emotional speech [J]. Brain and Language, 2008, 104(3): 262-269. |
| [2] | Pinheiro A P, Vasconcelos M, Dias M, et al. The music of language: An ERP investigation of the effects of musical training on emotional prosody processing [J]. Brain and Language, 2015, 140: 24-34. |
| [3] | 孙颖, 姚慧, 张雪英, 等. 基于混沌特性的情感语音特征提取[J]. 天津大学学报: 自然科学与工程技术, 2015, 48(8): 681-685.SUN Ying, YAO Hui, ZHANG Xueying, et al. Feature extraction of emotional speech based on chaotic characteristics [J]. Journal of Tianjin University: Science and Technology, 2015, 48(8): 681-685. (in Chinese) |
| [4] | Meng X, Yuan J, Li H. Automatic processing of valence differences in emotionally negative stimuli: Evidence from an ERP study [J]. Neuroscience Letters, 2009, 464(3): 228-232. |
| [5] | Rohaut B, Faugeras F, Chausson N, et al. Probing ERP correlates of verbal semantic processing in patients with impaired consciousness [J]. Neuropsychologia, 2015, 66: 279-292. |
| [6] | 曹晓华, 李超, 张焕婷, 等.字词认知N170成分及其发展[J]. 心理科学进展, 2013, 21(7): 1162-1172.CAO Xiaohua, LI Chao, ZHANG Huanting, et al. N170 component in words processing: The development and its mechanisms [J]. Advances in Psychological Science, 2013, 21(7): 1162-1172. (in Chinese) |
| [7] | Rabovsky M, McRae K. Simulating the N400 ERP component as semantic network error: Insights from a feature-based connectionist attractor model of word meaning [J]. Cognition, 2014, 132(1): 68-89. |
| [8] | Lepist？ T, Kujala T, Vanhala R, et al. The discrimination of and orienting to speech and non-speech sounds in children with autism [J]. Brain Research, 2005, 1066(S1/2): 147-157. |
| [9] | 席洁, 张林军, 张亚静, 等. 言语和非言语信号加工的早期分离: 来自 ERP 研究的证据[J]. 心理科学, 2010(2): 258-261.XI Jie, ZHANG Linjun, ZHANG Yajing, et al. The early dissociation of speech and nonspeech sounds: An ERP study [J]. Psychological Science, 2010(2): 258-261. (in Chinese) |
| [10] | Schirmer A, Kotz S A. Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing [J]. Trends in Cognitive Sciences, 2006, 10(1): 24-30. |
| [11] | Belin P, Fecteau S, Bedard C. Thinking the voice: Neural correlates of voice perception [J]. Trends in Cognitive Sciences, 2004, 8(3): 129-135. |
| [12] | Paulmann S, Ott D V M, Kotz S A. Emotional speech perception unfolding in time: The role of the basal ganglia [J]. PLoS One, 2011, 6(3), e17694. |
