|
(类)音乐节奏启动对言语加工的影响
|
Abstract:
基于语言和音乐的节奏相似之处,节奏启动效应成为近年音乐心理学研究的热点。本综述回顾了国内外关于音乐或类音乐节奏启动影响后续言语加工的相关研究。首先介绍了节奏启动效应对言语理解(语义、句法)的影响,发现当启动节奏与言语韵律匹配时会促进后续的言语理解。然后介绍了节奏启动影响言语产生的速度、边界和重音加工等相关研究。音乐节奏启动言语加工的确切性质和潜在机制尚不完全清楚,因此需要进一步的实证工作来探索。
Based on the similarities between the rhythms of language and music, rhythm priming effects have become a hot topic in recent music psychology research. This review examines both domestic and international studies on the influence of musical or pseudo-musical rhythm priming on subsequent speech processing. First, it introduces the effects of rhythm priming on speech comprehension (semantics, syntax), finding that matching the priming rhythm with speech prosody can facilitate subsequent speech comprehension. Then, it discusses studies on how rhythm priming affects speech production speed, boundaries, and accent processing. The exact nature and potential mechanisms of how musical rhythm priming influences speech processing remain unclear, necessitating further empirical research.
[1] | 彭聃龄, 郭桃梅(2003). 从语义启动效应看事件相关电位N400的实质. 心理科学, 26(4), 750. |
[2] | 杨依依(2019). 音乐启动刺激对言语生成速度的影响研究. 硕士学位论文, 重庆: 西南大学. |
[3] | Bedoin, N., Besombes, A., Escande, E., Dumont, A., Lalitte, P., & Tillmann, B. (2018). Boosting Syntax Training with Temporally Regular Musical Primes in Children with Cochlear Implants. Annals of Physical and Rehabilitation Medicine, 61, 365-371. https://doi.org/10.1016/j.rehab.2017.03.004 |
[4] | Bedoin, N., Brisseau, L., Molinier, P., Roch, D., & Tillmann, B. (2016). Temporally Regular Musical Primes Facilitate Subsequent Syntax Processing in Children with Specific Language Impairment. Frontiers in Neuroscience, 10, Article No. 245. https://doi.org/10.3389/fnins.2016.00245 |
[5] | Beier, E. J., & Ferreira, F. (2018). The Temporal Prediction of Stress in Speech and Its Relation to Musical Beat Perception. Frontiers in Psychology, 9, Article No. 431. https://doi.org/10.3389/fpsyg.2018.00431 |
[6] | Bolger, D., Trost, W., & Schön, D. (2013). Rhythm Implicitly Affects Temporal Orienting of Attention across Modalities. Acta Psychologica, 142, 238-244. https://doi.org/10.1016/j.actpsy.2012.11.012 |
[7] | Bosch, S., & Leminen, A. (2018). ERP Priming Studies of Bilingual Language Processing. Bilingualism: Language and Cognition, 21, 462-470. https://doi.org/10.1017/s1366728917000700 |
[8] | Brochard, R., Abecasis, D., Potter, D., Ragot, R., & Drake, C. (2003). The “Ticktock” of Our Internal Clock: Direct Brain Evidence of Subjective Accents in Isochronous Sequences. Psychological Science, 14, 362-366. https://doi.org/10.1111/1467-9280.24441 |
[9] | Brochard, R., Tassin, M., & Zagar, D. (2013). Got Rhythm… for Better and for Worse. Cross-Modal Effects of Auditory Rhythm on Visual Word Recognition. Cognition, 127, 214-219. https://doi.org/10.1016/j.cognition.2013.01.007 |
[10] | Canette, L., Bedoin, N., Lalitte, P., Bigand, E., & Tillmann, B. (2019). The Regularity of Rhythmic Primes Influences Syntax Processing in Adults. Auditory Perception & Cognition, 2, 163-179. https://doi.org/10.1080/25742442.2020.1752080 |
[11] | Canette, L., Lalitte, P., Bedoin, N., Pineau, M., Bigand, E., & Tillmann, B. (2020). Rhythmic and Textural Musical Sequences Differently Influence Syntax and Semantic Processing in Children. Journal of Experimental Child Psychology, 191, Article ID: 104711. https://doi.org/10.1016/j.jecp.2019.104711 |
[12] | Cason, N., & Schön, D. (2012). Rhythmic Priming Enhances the Phonological Processing of Speech. Neuropsychologia, 50, 2652-2658. https://doi.org/10.1016/j.neuropsychologia.2012.07.018 |
[13] | Cason, N., Astésano, C., & Schön, D. (2015a). Bridging Music and Speech Rhythm: Rhythmic Priming and Audio-Motor Training Affect Speech Perception. Acta Psychologica, 155, 43-50. https://doi.org/10.1016/j.actpsy.2014.12.002 |
[14] | Cason, N., Hidalgo, C., Isoard, F., Roman, S., & Schön, D. (2015b). Rhythmic Priming Enhances Speech Production Abilities: Evidence from Prelingually Deaf Children. Neuropsychology, 29, 102-107. https://doi.org/10.1037/neu0000115 |
[15] | Chern, A., Tillmann, B., Vaughan, C., & Gordon, R. L. (2018). New Evidence of a Rhythmic Priming Effect That Enhances Grammaticality Judgments in Children. Journal of Experimental Child Psychology, 173, 371-379. https://doi.org/10.1016/j.jecp.2018.04.007 |
[16] | Elmer, S., Klein, C., Kühnis, J., Liem, F., Meyer, M., & Jäncke, L. (2014). Music and Language Expertise Influence the Categorization of Speech and Musical Sounds: Behavioral and Electrophysiological Measurements. Journal of Cognitive Neuroscience, 26, 2356-2369. https://doi.org/10.1162/jocn_a_00632 |
[17] | Falk, S., & Dalla Bella, S. (2016). It Is Better When Expected: Aligning Speech and Motor Rhythms Enhances Verbal Processing. Language, Cognition and Neuroscience, 31, 699-708. https://doi.org/10.1080/23273798.2016.1144892 |
[18] | Falk, S., Volpi-Moncorger, C., & Dalla Bella, S. (2017). Auditory-Motor Rhythms and Speech Processing in French and German Listeners. Frontiers in Psychology, 8, Article No. 395. https://doi.org/10.3389/fpsyg.2017.00395 |
[19] | Fiveash, A., Bedoin, N., Lalitte, P., & Tillmann, B. (2020a). Rhythmic Priming of Grammaticality Judgments in Children: Duration Matters. Journal of Experimental Child Psychology, 197, Article ID: 104885. https://doi.org/10.1016/j.jecp.2020.104885 |
[20] | Fiveash, A., Schön, D., Canette, L., Morillon, B., Bedoin, N., & Tillmann, B. (2020b). A Stimulus-Brain Coupling Analysis of Regular and Irregular Rhythms in Adults with Dyslexia and Controls. Brain and Cognition, 140, Article ID: 105531. https://doi.org/10.1016/j.bandc.2020.105531 |
[21] | Flaugnacco, E., Lopez, L., Terribili, C., Montico, M., Zoia, S., & Schön, D. (2015). Music Training Increases Phonological Awareness and Reading Skills in Developmental Dyslexia: A Randomized Control Trial. PLOS ONE, 10, e0138715. https://doi.org/10.1371/journal.pone.0138715 |
[22] | Fodor, J. D. (2002). Psycholinguistics Cannot Escape Prosody. In Speech Prosody 2002 (pp. 83-90). ISCA. https://doi.org/10.21437/speechprosody.2002-12 |
[23] | Fotidzis, T. S., Moon, H., Steele, J. R., & Magne, C. L. (2018). Cross-Modal Priming Effect of Rhythm on Visual Word Recognition and Its Relationships to Music Aptitude and Reading Achievement. Brain Sciences, 8, Article No. 210. https://doi.org/10.3390/brainsci8120210 |
[24] | François, C., & Schön, D. (2014). Neural Sensitivity to Statistical Regularities as a Fundamental Biological Process That Underlies Auditory Learning: The Role of Musical Practice. Hearing Research, 308, 122-128. https://doi.org/10.1016/j.heares.2013.08.018 |
[25] | François, C., Chobert, J., Besson, M., & Schon, D. (2013). Music Training for the Development of Speech Segmentation. Cerebral Cortex, 23, 2038-2043. https://doi.org/10.1093/cercor/bhs180 |
[26] | Gentilucci, M., & Volta, R. D. (2008). Spoken Language and Arm Gestures Are Controlled by the Same Motor Control System. Quarterly Journal of Experimental Psychology, 61, 944-957. https://doi.org/10.1080/17470210701625683 |
[27] | Gould, L., McKibben, T., Ekstrand, C., Lorentz, E., & Borowsky, R. (2015). The Beat Goes On: The Effect of Rhythm on Reading Aloud. Language, Cognition and Neuroscience, 31, 236-250. https://doi.org/10.1080/23273798.2015.1089360 |
[28] | Gould, L., Mickleborough, M. J. S., Lorentz, E., Ekstrand, C., & Borowsky, R. (2018). A Behavioral and fMRI Examination of the Effect of Rhythm on Reading Noun-Verb Homographs Aloud. Language, Cognition and Neuroscience, 33, 829-849. https://doi.org/10.1080/23273798.2018.1442012 |
[29] | Haegens, S., & Zion Golumbic, E. (2018). Rhythmic Facilitation of Sensory Processing: A Critical Review. Neuroscience & Biobehavioral Reviews, 86, 150-165. https://doi.org/10.1016/j.neubiorev.2017.12.002 |
[30] | Hidalgo, C., Falk, S., & Schön, D. (2017). Speak on Time! Effects of a Musical Rhythmic Training on Children with Hearing Loss. Hearing Research, 351, 11-18. https://doi.org/10.1016/j.heares.2017.05.006 |
[31] | Hilton, C. B., & Goldwater, M. B. (2021). Linguistic Syncopation: Meter-Syntax Alignment Affects Sentence Comprehension and Sensorimotor Synchronization. Cognition, 217, Article ID: 104880. https://doi.org/10.1016/j.cognition.2021.104880 |
[32] | Jäncke, L. (2012). The Relationship between Music and Language. Frontiers in Psychology, 3, Article No. 123. https://doi.org/10.3389/fpsyg.2012.00123 |
[33] | Jones, M. R. (2018). Time Will Tell: A Theory of Dynamic Attending. Perception, 49, 488-491. |
[34] | Jones, M. R., & Boltz, M. (1989). Dynamic Attending and Responses to Time. Psychological Review, 96, 459-491. https://doi.org/10.1037//0033-295x.96.3.459 |
[35] | Jones, M. R., Moynihan, H., MacKenzie, N., & Puente, J. (2002). Temporal Aspects of Stimulus-Driven Attending in Dynamic Arrays. Psychological Science, 13, 313-319. https://doi.org/10.1111/1467-9280.00458 |
[36] | Jungers, M. K., Hupp, J. M., & Dickerson, S. D. (2016). Language Priming by Music and Speech: Evidence of a Shared Processing Mechanism. Music Perception, 34, 33-39. https://doi.org/10.1525/mp.2016.34.1.33 |
[37] | Jungers, M. K., Palmer, C., & Speer, S. R. (2002). Time after Time: The Coordinating Influence of Tempo in Music and Speech. Cognitive Processing, 2, 21-35. |
[38] | Kassler, M. (1983). A Generative Theory of Tonal Music. Musicology Australia, 9, 72-73. https://doi.org/10.1080/08145857.1986.10415169 |
[39] | Kelso, J. S., Tuller, B., & Harris, K. S. (1983). A “Dynamic Pattern” Perspective on the Control and Coordination of Movement. Springer. |
[40] | Kotz, S. A., & Gunter, T. C. (2015). Can Rhythmic Auditory Cuing Remediate Language‐Related Deficits in Parkinson’s Disease? Annals of the New York Academy of Sciences, 1337, 62-68. https://doi.org/10.1111/nyas.12657 |
[41] | Kotz, S. A., & Schwartze, M. (2010). Cortical Speech Processing Unplugged: A Timely Subcortico-Cortical Framework. Trends in Cognitive Sciences, 14, 392-399. https://doi.org/10.1016/j.tics.2010.06.005 |
[42] | Kraus, N., Hornickel, J., Strait, D. L., Slater, J., & Thompson, E. (2014). Engagement in Community Music Classes Sparks Neuroplasticity and Language Development in Children from Disadvantaged Backgrounds. Frontiers in Psychology, 5, Article No. 1403. https://doi.org/10.3389/fpsyg.2014.01403 |
[43] | Ladányi, E., Lukács, Á., & Gervain, J. (2021). Does Rhythmic Priming Improve Grammatical Processing in Hungarian‐Speaking Children with and without Developmental Language Disorder? Developmental Science, 24, e13112. https://doi.org/10.1111/desc.13112 |
[44] | Ladányi, E., Persici, V., Fiveash, A., Tillmann, B., & Gordon, R. L. (2020). Is Atypical Rhythm a Risk Factor for Developmental Speech and Language Disorders? WIREs Cognitive Science, 11, e1528. https://doi.org/10.1002/wcs.1528 |
[45] | Large, E. W., & Jones, M. R. (1999). The Dynamics of Attending: How People Track Time-Varying Events. Psychological Review, 106, 119-159. https://doi.org/10.1037//0033-295x.106.1.119 |
[46] | Large, E. W., & Palmer, C. (2002). Perceiving Temporal Regularity in Music. Cognitive Science, 26, 1-37. https://doi.org/10.1207/s15516709cog2601_1 |
[47] | Large, E. W., Herrera, J. A., & Velasco, M. J. (2015). Neural Networks for Beat Perception in Musical Rhythm. Frontiers in Systems Neuroscience, 9, Article No. 159. https://doi.org/10.3389/fnsys.2015.00159 |
[48] | Manning, F., & Schutz, M. (2013). “Moving to the Beat” Improves Timing Perception. Psychonomic Bulletin & Review, 20, 1133-1139. https://doi.org/10.3758/s13423-013-0439-7 |
[49] | Munhall, K. G., Jones, J. A., Callan, D. E., Kuratate, T., & Vatikiotis-Bateson, E. (2004). Visual Prosody and Speech Intelligibility: Head Movement Improves Auditory Speech Perception. Psychological Science, 15, 133-137. https://doi.org/10.1111/j.0963-7214.2004.01502010.x |
[50] | Parrell, B., Goldstein, L., Lee, S., & Byrd, D. (2014). Spatiotemporal Coupling between Speech and Manual Motor Actions. Journal of Phonetics, 42, 1-11. https://doi.org/10.1016/j.wocn.2013.11.002 |
[51] | Patel, A. D. (2003). Language, Music, Syntax and the Brain. Nature Neuroscience, 6, 674-681. https://doi.org/10.1038/nn1082 |
[52] | Patel, A. D. (2011). Why Would Musical Training Benefit the Neural Encoding of Speech? The OPERA Hypothesis. Frontiers in Psychology, 2, Article No. 142. https://doi.org/10.3389/fpsyg.2011.00142 |
[53] | Pitt, M. A., & Samuel, A. G. (1990). The Use of Rhythm in Attending to Speech. Journal of Experimental Psychology: Human Perception and Performance, 16, 564-573. https://doi.org/10.1037//0096-1523.16.3.564 |
[54] | Przybylski, L., Bedoin, N., Krifi-Papoz, S., Herbillon, V., Roch, D., Léculier, L. et al. (2013). Rhythmic Auditory Stimulation Influences Syntactic Processing in Children with Developmental Language Disorders. Neuropsychology, 27, 121-131. https://doi.org/10.1037/a0031277 |
[55] | Rochet-Capellan, A., Laboissière, R., Galván, A., & Schwartz, J. (2008). The Speech Focus Position Effect on Jaw-Finger Coordination in a Pointing Task. Journal of Speech, Language, and Hearing Research, 51, 1507-1521. https://doi.org/10.1044/1092-4388(2008/07-0173) |
[56] | Stefaniak, J. D., Lambon Ralph, M. A., De Dios Perez, B., Griffiths, T. D., & Grube, M. (2021). Auditory Beat Perception Is Related to Speech Output Fluency in Post-Stroke Aphasia. Scientific Reports, 11, Article No. 3168. https://doi.org/10.1038/s41598-021-82809-w |
[57] | Su, Y. (2014). Visual Enhancement of Auditory Beat Perception across Auditory Interference Levels. Brain and Cognition, 90, 19-31. https://doi.org/10.1016/j.bandc.2014.05.003 |
[58] | Tooley, K. M., Konopka, A. E., & Watson, D. G. (2018). Assessing Priming for Prosodic Representations: Speaking Rate, Intonational Phrase Boundaries, and Pitch Accenting. Memory & Cognition, 46, 625-641. https://doi.org/10.3758/s13421-018-0789-5 |
[59] | Zhang, N., & Zhang, Q. (2019). Rhythmic Pattern Facilitates Speech Production: An ERP Study. Scientific Reports, 9, Article No. 12974. https://doi.org/10.1038/s41598-019-49375-8 |