熟练与非熟练中英双语者的情绪韵律识别
Recognition of Emotional Prosody in the Proficient and the Non-Proficient Chinese-English Bilinguals

DOI: 10.12677/AP.2020.102025, PP. 193-204

Keywords: 语言熟练度，双语，情绪韵律，韵律
Language Proficiency, Bilingual, Emotional Prosody, Prosody

Full-Text   Cite this paper   Add to My Lib

Abstract:

正确地感知口语中蕴含的情绪对言语交际至关重要。本研究将影响言语交流情绪感知的重要因素——情绪韵律，与语言熟练度结合，探究语言熟练度是否为影响情绪韵律识别的因素。为此，熟练中英双语者与非熟练中英双语者分别被要求在听到了蕴含7种情绪之一的中英文假句后，做出情绪分类判断。基于情绪识别正确率制作的混淆矩阵显示，相同效价各情绪易被混淆。以经反正弦转换的无偏击中率(Hu分数)为因变量的方差分析结果表明，虽然语言熟练度主效应边缘显著，但该因素与其他自变量的交互作用均不显著。由此可推测，语言熟练度不作为影响双语者情绪韵律识别的因素而存在，人们识别第二语言情绪韵律的能力在发展过程中保持稳定趋势，难以受到其他因素影响。
When we are communicating with others, it is important to perceive the emotion contained in the language correctly. The present study put emotional prosody recognition and language proficiency together, aiming at investigating whether language proficiency could affect the recognition of emotional prosody. To this end, some Chinese and English pseudo sentences were pronounced in 7 emotions (anger, disgust, fear, happiness, neutral, pleasant surprise, and sadness) by a native Chinese speaker and a native English speaker, respectively. These auditory stimuli were then presented to 20 proficient Chinese-English bilinguals and 20 non-proficient Chinese-English bi-linguals. Recognition accuracy for each emotion was made into a confusion matrix. With the arc-sine-transformed unbiased hit rate (Hu scores) serving as a dependent variable, a three-way re-peated measure ANOVA was also performed. It is revealed by the confusion matrix that emotions shared the same valence were usually confounded by the participants. The results of repeated measures ANOVAs presented that except for the factor of language proficiency, which only had a marginally significant main effect, all the independent variables showed significant main effects. Also, there was a significant two-way interaction effect between emotions and language of materials. No other interaction effect was significant. In conclusion, language proficiency does not exist as an influence factor for emotional prosody recognition, which might be explained by the fact that recognition of emotional prosody can hardly be affected by the level of language ability we gained by nurture.

References

[1]	陈煦海(2011). 刺激特征和任务要求对情绪韵律加工的调制——来自电生理的证据. 博士论文, 北京: 中国科学院.
[2]	高敏(2016). 基于动态面部表情的东方人情绪识别的研究. 硕士论文, 成都: 电子科技大学.
[3]	黄希庭(2011). 心理学导论. 北京: 人民教育出版社.
[4]	黄贤军, 张伟欣(2014). 两种任务下情绪韵律的加工进程. 心理科学, 37(4), 851-856.
[5]	江爱世(2013). 情绪韵律的动态加工机制. 博士论文, 北京: 中国科学院大学.
[6]	刘晓燕(2008). QQ面部表情图片的识别研究. 硕士论文, 长沙: 湖南师范大学.
[7]	卢植, 涂柳(2010). 二语习得年龄与高熟练度中英文双语者心理词典表征. 外国语(上海外国语大学学报), 4, 47-56.
[8]	毛伟宾, 杨治良, 王林松, 袁建伟(2008). 非熟练中-英双语者跨语言的错误记忆通道效应. 心理学报, 40(3), 274-282.
[9]	王一牛, 周立明, 罗跃嘉(2008). 汉语情感词系统的初步编制及评定. 中国心理卫生杂志, 22(8), 608-612.
[10]	姚温青(2014). 声音情绪的跨文化识别研究——以汉语、藏语和维语为例. 硕士论文, 兰州: 西北师范大学.
[11]	张积家, 王悦(2012). 熟练汉-英双语者的语码切换机制——来自短语水平的证据. 心理学报, 44(2), 166-178.
[12]	Bachorowski, J. A. (1999). Vocal Expression and Perception of Emotion. Current Directions in Psychological Science, 8, 53-57. https://doi.org/10.1111/1467-8721.00013
[13]	Bezooijen, R. V., Otto, S. A., & Heenan, T. A. (1983). Recognition of Vocal Expressions of Emotion. Journal of Cross-Cultural Psychology, 14, 387-406. https://doi.org/10.1177/0022002183014004001
[14]	Bostanov, V., & Kotchoubey, B. (2004). Recognition of Affec-tive Prosody: Continuous Wavelet Measures of Event-Related Brain Potentials to Emotional Exclamations. Psychophysi-ology, 41, 259-268. https://doi.org/10.1111/j.1469-8986.2003.00142.x
[15]	Chakraborty, R. (2011). Influence of L2 Proficiency on Speech Movement Variability: Production of Prosodic Contrasts by Bengali-English Speakers. Bilingualism: Language and Cognition, 14, 489-505. https://doi.org/10.1017/S1366728910000441
[16]	Cornew, L., Carver, L., & Love, T. (2009). There’s More to Emo-tion than Meets the Eye: A Processing Bias for Neutral Content in the Domain of Emotional Prosody. Cognition and Emo-tion, 24, 1133-1152. https://doi.org/10.1080/02699930903247492
[17]	Dimoska, A., Mcdonald, S., Pell, M. C., Tate, R. L., & James, C. M. (2010). Recognizing Vocal Expressions of Emotion in Patients with Social Skills Deficits Following Traumatic Brain Injury. Journal of the International Neuropsychological Society, 16, 369-382. https://doi.org/10.1017/S1355617709991445
[18]	Hawk, S. T., van Kleef, G. A., Fischer, A. H., & van der Schalk, J. (2009). “Worth a Thousand Words”: Absolute and Relative Decoding of Nonlinguistic Affect Vocalizations. Emotion, 9, 293-305. https://doi.org/10.1037/a0015178
[19]	Kotz, S. A., & Paulmann, S. (2007). When Emotional Prosody and Semantics Dance Cheek to Cheek: ERP Evidence. Brain Research, 1151, 107-118. https://doi.org/10.1016/j.brainres.2007.03.015
[20]	Lima, C. F., Castro, S. L., & Scott, S. K. (2013). When Voices Get Emotional: A Corpus of Nonverbal Vocalizations for Research on Emotion Processing. Behavior Research Methods, 45, 1234-1245. https://doi.org/10.3758/s13428-013-0324-3
[21]	Min, C. S., & Schirmer, A. (2011). Perceiving Verbal and Vocal Emotions in a Second Language. Cognition and Emotion, 25, 1376-1392. https://doi.org/10.1080/02699931.2010.544865
[22]	Ortony, A., & Tumer, T. J. (1990). What’s Basic about Basic Emotions? Psychological Review, 3, 315-331. https://doi.org/10.1037/0033-295X.97.3.315
[23]	Owren, M. J., Amoss, R. T., & Rendall, D. (2011). Two Organiz-ing Principles of Vocal Production: Implications for Nonhuman and Human Primates. American Journal of Primatology, 73, 530-544. https://doi.org/10.1002/ajp.20913
[24]	Paulmann, S., & Uskul, A. K. (2013). Cross-Cultural Emotional Prosody Recognition: Evidence from Chinese and British Listeners. Cognition and Emotion, 28, 230-244. https://doi.org/10.1080/02699931.2013.812033
[25]	Paulmann, S., Furnes, D., B？kenes, A. M., & Cozzolino, P. J. (2016). How Psychological Stress Affects Emotional Prosody. PLoS ONE, 11, e0165022. https://doi.org/10.1371/journal.pone.0165022
[26]	Ponari, M., Rodríguez-Cuadrado, S., Vinson, D., Fox, N., Costa, A., & Vigliocco, G. (2015). Processing Advantage for Emotional Words in Bilingual Speakers. Emotion, 15, 644-652. https://doi.org/10.1037/emo0000061
[27]	Schirmer, A., & Kotz, S. A. (2006). Beyond the Right Hemisphere: Brain Mechanisms Mediating Vocal Emotional Processing. Trends in Cognitive Sciences, 10, 24-30. https://doi.org/10.1016/j.tics.2005.11.009
[28]	Shtyrov, Y. (2011). Fast Mapping of Novel Word Forms Traced Neurophysiologically. Frontiers in Psychology, 2, 340. https://doi.org/10.3389/fpsyg.2011.00340
[29]	Thompson, W. F., & Balkwill, L.-L. (2006). Decoding Speech Pros-ody in Five Languages. Semiotica, 158, 407-424. https://doi.org/10.1515/SEM.2006.017
[30]	Uskul, A. K., Paulmann, S., & Weick, M. (2016). Social Power and Recognition of Emotional Prosody: High Power Is Associated with Lower Recognition Accuracy than Low Power. Emo-tion, 16, 11-15. https://doi.org/10.1037/emo0000110
[31]	van den Brink, D., Van Berkum, J. J. A., Bastiaansen, M. C. M., Tesink, C. M. J. Y., Kos, M., Buitelaar, J. K., & Hagoort, P. (2012). Empathy Matters: ERP Evidence for In-ter-Individual Differences in Social Language Processing. Social Cognitive and Affective Neuroscience, 7, 173-183. https://doi.org/10.1093/scan/nsq094
[32]	Wagner, H. L. (1993). On Measuring Performance in Category Judgment Studies of Nonverbal Behavior. Journal of Nonverbal Behavior, 17, 3-28. https://doi.org/10.1007/BF00987006

Full-Text