全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...
PLOS ONE  2014 

An Eye-Tracking Paradigm for Analyzing the Processing Time of Sentences with Different Linguistic Complexities

DOI: 10.1371/journal.pone.0100186

Full-Text   Cite this paper   Add to My Lib

Abstract:

An eye-tracking paradigm was developed for use in audiology in order to enable online analysis of the speech comprehension process. This paradigm should be useful in assessing impediments in speech processing. In this paradigm, two scenes, a target picture and a competitor picture, were presented simultaneously with an aurally presented sentence that corresponded to the target picture. At the same time, eye fixations were recorded using an eye-tracking device. The effect of linguistic complexity on language processing time was assessed from eye fixation information by systematically varying linguistic complexity. This was achieved with a sentence corpus containing seven German sentence structures. A novel data analysis method computed the average tendency to fixate the target picture as a function of time during sentence processing. This allowed identification of the point in time at which the participant understood the sentence, referred to as the decision moment. Systematic differences in processing time were observed as a function of linguistic complexity. These differences in processing time may be used to assess the efficiency of cognitive processes involved in resolving linguistic complexity. Thus, the proposed method enables a temporal analysis of the speech comprehension process and has potential applications in speech audiology and psychoacoustics.

References

[1]  Laroche C, Soli S, Giguere C, Lagace J, Vaillancourt V, et al. (2003) An approach to the development of hearing standards for hearing-critical jobs. Noise Health 6: 17–37. doi: 10.1080/14992020801894824
[2]  Ozimek E, Warzybok A, Kutzner D (2010) Polish sentence matrix test for speech intelligibility measurement in noise. Int J Audiol 49: 444–454. doi: 10.3109/14992021003681030
[3]  Haumann S, Hohmann V, Meis M, Herzke T, Lenarz T, et al. (2012) Indication criteria for cochlear implants and hearing aids: Impact of audiological and non-audiological findings. Audiol Research 2: 55–64. doi: 10.4081/audiores.2012.e12
[4]  Zokoll MA, Hochmuth S, Warzybok A, Wagener KC, Buscherm?hle M, et al. (2013) Speech-in-noise tests for multilingual hearing screening and diagnostics. Am J Audiol 22: 175–178. doi: 10.1044/1059-0889(2013/12-0061)
[5]  Plomp R, Mimpen AM (1979) Improving the reliability of testing the speech reception threshold for sentences. Audiol 18(1): 43–52. doi: 10.3109/00206097909072618
[6]  Hagerman B (1982) Sentences for testing speech intelligibility in noise. Scand Audiol 11(2): 79–87. doi: 10.3109/01050398209076203
[7]  Kollmeier B, Wesselkamp M (1997) Development and evaluation of a German sentence test for objective and subjective speech intelligibility assessment. J Acoust Soc Am 102(4): 2412–2421. doi: 10.1121/1.419624
[8]  Nilsson M, Soil SD, Sullivan JA (1994) Development of the hearing in noise test for the measurement of speech reception thresholds in quiet and in noise. J Acoust Soc Am 95(2): 1085–1099. doi: 10.1121/1.408469
[9]  Wingfield A, McCoy SL, Peelle JE, Tun PA, Cox LC (2006) Effects of adult aging and hearing loss on comprehension of rapid speech varying in syntactic complexity. J Am Ac Audiol 17: 487–497. doi: 10.3766/jaaa.17.7.4
[10]  Tun PA, Benichov J, Wingfield A (2010) Response latencies in auditory sentence comprehension: Effects of linguistic versus perceptual challenge. Psychol Aging 25(3): 730–735. doi: 10.1037/a0019300
[11]  Kalikow DN, Stevens KN (1977) Development of a test of speech intelligibility in noise using sentence materials with controlled word predictability. J Acoust Soc Am 61: 1337–1351. doi: 10.1121/1.381436
[12]  Boothroyd A, Nittrouer S (1988) Mathematical treatment of context effects in phoneme and word recognition. J Acoust Soc Am 84(1): 101–114. doi: 10.1121/1.396976
[13]  Uslar VN, Ruigendijk E, Hamann C, Brand T, Kollmeier B (2011) Sentence complexity effects in a German audiometric sentence intelligibility test: May we ignore psycholinguistics when testing speech in noise? Int J Audiol 50: 621–631. doi: 10.3109/14992027.2011.582166
[14]  Uslar VN, Carroll R, Hanke M, Hamann C, Ruigendijk E, et al. (2013) Development and evaluation of a linguistically and audiologically controlled sentence intelligibility test. J Acoust Soc Am 134(4): 3039–3056. doi: 10.1121/1.4818760
[15]  Pratt J, Dodd M, Welsh T (2006) Growing older does not always mean moving slower Examining aging and the saccadic motor system. J Motor Behav 38: 373–382. doi: 10.3200/jmbr.38.5.373-382
[16]  Cerella J, Hale S (1994) The rise and fall in information-processing rates over the life span. Acta Psychol 86: 109–197. doi: 10.1016/0001-6918(94)90002-7
[17]  Cooper RM (1974) The control of eye fixation by the meaning of spoken language: A newmethodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychol 6: 84–107.
[18]  Huettig F, Rommers J, Meyer AS (2011) Using the visual world paradigm to study language processing: A review and critical evaluation. Acta Psychol 137: 151–171. doi: 10.1016/j.actpsy.2010.11.003
[19]  Tanenhaus MK, Spivey-Knowiton MJ, Eberharda KM, Sedivy JC (1995) Integration of visual and linguistic information in spoken language comprehension. Science 268: 1632–1634. doi: 10.1126/science.7777863
[20]  Eberhard KM, Spivey-Knowlton MJ, Sedivy JC, Tanenhaus MK (1995) Eye movements as a window into real-time spoken language comprehension in natural contexts. J Psycholinguist Res 24(6): 409–436. doi: 10.1007/bf02143160
[21]  Allopenna PD, Magnuson JS, Tanenhaus MK (1998) Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. J Mem Lang 38: 419–439. doi: 10.1006/jmla.1997.2558
[22]  Altmann GTM, Kamide Y (1999) Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition 73: 247–264. doi: 10.1016/s0010-0277(99)00059-1
[23]  Snedeker J, Trueswell JC (2004) The developing constraints on parsing decisions: The role of lexical-biases and referential scenes in child and adult sentence processing. Cognitive Psychol 49(3): 238–299. doi: 10.1016/j.cogpsych.2004.03.001
[24]  Altmann GTM, Kamide Y (2007) The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing. J Mem Lang 57: 502–518. doi: 10.1016/j.jml.2006.12.004
[25]  Kamide Y, Altmann GTM, Haywood SL (2003) The time course of prediction in incremental sentence processing: Evidence from anticipatory eye movements. J Mem Lang 49: 133–156. doi: 10.1016/s0749-596x(03)00023-8
[26]  Knoeferle P (2007) Comparing the time-course of processing initially ambiguous and unambiguous German SVO/OVS sentences in depicted events. In: van Gompel R, Fischer M, Murray W, Hill R, editors. Eye Movements: A Window on Mind and Brain. Oxford: Elsevier. pp. 517–533.
[27]  Knoeferle P, Crocker MW (2006) The coordinated interplay of scene, utterance, and world knowledge: Evidence from eye tracking. Cognitive Science 30(3): 481–529. doi: 10.1207/s15516709cog0000_65
[28]  Knoeferle P, Crocker MW (2007) The influence of recent scene events on spoken comprehension: Evidence from eye movements. J Mem Lang 57: 519–543. doi: 10.1016/j.jml.2007.01.003
[29]  Knoeferle P, Crocker MW, Scheepers C, Pickering MJ (2005) The influence of the immediate visual context on incremental thematic role-assignment: Evidence from eye-movements in depicted events. Cognition 95: 95–127. doi: 10.1016/j.cognition.2004.03.002
[30]  Chambers CG, Tanenhaus MK, Eberhard KM, Filip H, Carlson GN (2002) Circumscribing referential domains during real-time sentence comprehension. J Mem Lang 47: 30–49. doi: 10.1006/jmla.2001.2832
[31]  Huettig F, McQueen JM (2007) The tug of war between phonological, semantic, and shape information in language-mediated visual search. J Mem Lang 57: 460–482. doi: 10.1016/j.jml.2007.02.001
[32]  Barr DJ, Gann TM, Russell SP (2011) Anticipatory baseline effects and information integration in visual world studies. Acta Psychol 137: 201–207. doi: 10.1016/j.actpsy.2010.09.011
[33]  Arnold JE, Fagnano M, Tanenhaus MK (2003) Disfluencies signal theee, um, new information. J Psycholinguist Res 32: 25–36.
[34]  Kaiser E, Trueswell JC (2008) Interpreting pronouns and demonstratives in Finnish: Evidence for a form-specific approach to reference resolution. Lang Cogn Process 23(5): 709–748. doi: 10.1080/01690960701771220
[35]  Efron B, Tibshirani RJ (1993) An introduction to the bootstrap. New York: Chapman and Hall. 436 p.
[36]  van Zandt T (2002) Analysis of response time distributions. In: Wixted JT, editor. Stevens' handbook of experimental psychology: Vol.4. Methodology in experimental psychology, (third edition). New York: Wiley. pp. 461–516.
[37]  McMurray B, Clayards MA, Tanenhaus MK, Aslin RN (2008) Tracking the time course of phonetic cue integration during spoken word recognition. Psychometric Bulletin & Review 15(6): 1064–1071. doi: 10.3758/pbr.15.6.1064
[38]  Toscano J, McMurray B (2012) Cue-integration and context effects in speech: Evidence against speaking-rate normalization. Atten Percept Psychophys 74(6): 1284–1301. doi: 10.3758/s13414-012-0306-z
[39]  Bader M, Bayer J (2006) Case and linking in language comprehension: Evidence from German. Berlin: Springer 319 p.
[40]  Weskott T, H?rnig R, Fanselow G, Kliegl R (2011) Contextual licensing of marked OVS word order in German. Linguistische Berichte 225: 3–18.
[41]  Bader M, Meng M (1999) Subject-object ambiguities in German embedded clauses: An across-the-board comparison. J Psycholinguist Res 28(2): 121–143.
[42]  Gorrell P (2000) The subject-before-object preference in German clauses. In: Hemforth B, Konieczny L, editors. German sentence processing. Dordrecht: Kluwer Academic Publishers. pp. 25–63.
[43]  Fanselow G, Lenertová D,Weskott T (2008) Studies on the acceptability of object movement to spec, CP. In: Steube A, editor. Language, Context & Cognition: The discourse potential of underspecified structures. Berlin: De Gruyter. pp. 413–438.
[44]  Gibson E (2000) The dependency locality theory: A distance-based theory of linguistic complexity. In: Miyashita Y, Marantz A, O'Neil W, editors. Image, Language, Brain. Cambridge, MA: Massachusetts Institute of Technology Press, pp. 95–126.
[45]  Gordon PC, Hendrick R, Levine WH (2002) Memory load interference in syntactic processing. Psychol Science 13(5): 425–430. doi: 10.1111/1467-9280.00475
[46]  Carroll R, Ruigendijk E (2013) The effect of syntactic complexity on processing sentences in noise. J Psycholinguist Res 42(2): 139–59. doi: 10.1007/s10936-012-9213-7
[47]  Altmann GTM (1998) Ambiguity in sentence processing. Trends Cogn Sci 2: 146–152. doi: 10.1016/s1364-6613(98)01153-x
[48]  Ben-David BM, Chambers CG, Danemana M, Pichora-Fuller MK, Reingold EM, et al. (2011) Effects of aging and noise on real-time spoken word recognition: Evidence from eye movements. J Speech Lang Hear Res 54: 243–262. doi: 10.1044/1092-4388(2010/09-0233)
[49]  Sherbecoe RL, Studebaker GA (2004) Supplementary formulas and tables for calculating and interconverting speech recognition scores in transformed arcsine units. Int J Audiol 43: 442–448. doi: 10.1080/14992020400050056
[50]  Wingfield A, Tun PA (2007) Cognitive supports and cognitive constraints on comprehension of spoken language. J Am Ac Audiol 18(7): 548–558. doi: 10.3766/jaaa.18.7.3
[51]  Piquado T, Isaacowitz D, Wingfield A (2010) Pupillometry as a measure of cognitive effort in younger and older adults. Psychophysiology 47: 560–569. doi: 10.1111/j.1469-8986.2009.00947.x
[52]  Marzinzik M (2000) Noise reduction schemes for digital hearing aids and their use for the hearing impaired. [dissertation], Oldenburg: Carl von Ossietzky Universit?t, 132 p.
[53]  Fredelake S, Holube I, Schlüter A, Hansen M (2012) Measurement and prediction of the acceptable noise level for single-microphone noise reduction algorithms. Int J Audiol 51(4): 299–308. doi: 10.3109/14992027.2011.645075
[54]  Bentler RA (2005) Effectiveness of directional microphones and noise reduction schemes in hearing aids: A systematic review of the evidence. J Am Ac Audiol 16(7): 473–484. doi: 10.3766/jaaa.16.7.7
[55]  Brons I, Houben R, Dreschler WA (2013) Perceptual effects of noise reduction with respect to personal preference, speech intelligibility, and listening effort. Ear Hear 34(1): 29–41. doi: 10.1097/aud.0b013e31825f299f
[56]  Sarampalis A, Kalluri S, Edwards B, Hafter E (2009) Objective measures of listening effort: Effects of background noise and noise reduction. J Speech Lang Hear Res 52: 1230–1240. doi: 10.1044/1092-4388(2009/08-0111)
[57]  Schlueter A, Lemke U, Kollmeier B, Holube I (2014) Intelligibility of time-compressed speech: The effect of uniform versus non-uniform time-compression algorithms. J Acoust Soc Am 135(3): 1541–1555. doi: 10.1121/1.4863654

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133