The language difficulties often seen in individuals with autism might stem from an inability to integrate audiovisual information, a skill important for language development. We investigated whether 9-month-old siblings of older children with autism, who are at an increased risk of developing autism, are able to integrate audiovisual speech cues. We used an eye-tracker to record where infants looked when shown a screen displaying two faces of the same model, where one face is articulating/ba/and the other/ga/, with one face congruent with the syllable sound being presented simultaneously, the other face incongruent. This method was successful in showing that infants at low risk can integrate audiovisual speech: they looked for the same amount of time at the mouths in both the fusible visual/ga/？ audio/ba/and the congruent visual/ba/？ audio/ba/displays, indicating that the auditory and visual streams fuse into a McGurk-type of syllabic percept in the incongruent condition. It also showed that low-risk infants could perceive a mismatch between auditory and visual cues: they looked longer at the mouth in the mismatched, non-fusible visual/ba/？ audio/ga/display compared with the congruent visual/ga/？ audio/ga/display, demonstrating that they perceive an uncommon, and therefore interesting, speech-like percept when looking at the incongruent mouth (repeated ANOVA: displays x fusion/mismatch conditions interaction: F(1,16) = 17.153, p = 0.001). The looking behaviour of high-risk infants did not differ according to the type of display, suggesting difficulties in matching auditory and visual information (repeated ANOVA, displays x conditions interaction: F(1,25) = 0.09, p = 0.767), in contrast to low-risk infants (repeated ANOVA: displays x conditions x low/high-risk groups interaction: F(1,41) = 4.466, p = 0.041). In some cases this reduced ability might lead to the poor communication skills characteristic of autism.
References
[1]
American Psychiatric Association (200) Diagnostic and statistical manual of mental disorders–Text revision (DSM-IV-TR; 4th ed.) Washington, DC, American Psychiatric Association. 943 p.
[2]
Hus V, Pickles A, Cook EH, Risi S, Lord C (2007) Using the autism diagnostic interview-revised to increase phenotypic homogeneity in genetic studies of autism. Biol Psychiatry 61(4): 438–448.
[3]
Koning C, Magill-Evans J (2001) Social and language skills in adolescent boys with Asperger syndrome. Autism 5(1): 23–36.
[4]
Howlin P (2003) Outcome in high-functioning adults with autism with and without early language delays: implications for the differentiation between autism and Asperger syndrome. J Autism Dev Disord 33: 3–13.
[5]
Tager-Flusberg H, Paul R, Lord C (2005) Language and communication in autism. In: Volkmar FR, Paul R, Klin A, Cohen D, editors. Handbook of autism and pervasive developmental disorders. Hoboken: John Wiley & Sons, Inc. 1: 335–364.
[6]
Abrahams BS, Geschwind DH (2008) Advances in autism genetics: on the threshold of a new neurobiology. Nat Rev Genet 9(5): 341–55.
[7]
Elsabbagh M, Johnson MH (2010) Getting answers from babies about autism. Trends Cogn Sci 14(2): 81–87.
[8]
Megnin O, Flitton A, Jones C, de Haan M, Baldeweg T, et al. Audiovisual speech integration in autism spectrum disorder: ERP evidence for atypicalities in lexical-semantic processing. Autism Res. In press. (in press).
[9]
Binnie CA, Montgomery AA, Jackson PL (1974) Auditory and visual contributions to the perception of consonants. J. Speech Hear Res 17: 619–630.
[10]
Dodd B (1977) The role of vision in the perception of speech. Perception 6: 31–40.
[11]
Legerstee M (1990) Infants use multimodal information to imitate speech sounds. Infant Behav Dev 17: 829–840.
[12]
Hindley P (2005) Development of deaf and blind children. Psychiatry 4(7): 45–48.
[13]
Ozonoff S, Young G, Carter AS, Messinger D, Yirmiya N, et al. Recurrence risk for autism spectrum disorders: a Baby Siblings Research Consortium Study. Pediatrics. In press. (in press).
[14]
Pickles A, Starr E, Kazak S, Bolton P, Papanikolaou K, et al. (2000) Variable expression of the autism broader phenotype: findings from extended pedigrees. J Child Psychol Psychiatry 41: 491–502.
[15]
Smith EG, Bennetto L (2007) Audiovisual speech integration and lipreading in autism. J Child Psychol Psychiatry 48: 813–821.
Iarocci G, McDonald J (2006) Sensory integration and the perceptual experience of persons with autism. J Autism Dev Disord 36: 77–90.
[18]
de Gelder B, Vroomen J, van der Heide L (1991) Face recognition and lip-reading in autism. Eur J Cogn Psychol 3: 69–86.
[19]
Massaro DW (1998) Perceiving talking faces: From speech perception to a behavioral principle. Cambridge, Massachusetts: MIT Press. 494 p.
[20]
Mongillo EA, Irwin JR, Whalen DH, Klaiman C, Carter AS, et al. (2008) Audiovisual processing in children with and without autism spectrum disorders. J Autism Dev Disord 38: 1349–1358.
[21]
Irwin JR, Tornatore LA, Brancazio L, Whalen DH (2011) Can children with autism spectrum disorders “hear” a speaking face? Child Dev 82: 1397–1403.
[22]
Massaro DW, Bosseler A (2003) Perceiving speech by ear and eye: Multimodal integration by children with autism. J Dev Learn Disord 7: 111–144.
[23]
Williams JHG, Massaro DW, Peela NJ, Bosseler A, Suddendorf T (2004) Visual–auditory integration during speech imitation in autism. Res Dev Disabil 25: 559–575.
[24]
Mongillo EA, Irwin JR, Whalen DH, Klaiman C, Carter AS, et al. (2008) Audiovisual processing in children with and without autism spectrum disorders. J Autism Dev Disord 38: 1349–1358.
[25]
Kushnerenko E, Teinonen T, Volein A, Csibra G (2008) Electrophysiological evidence of illusory audiovisual speech percept in human infants. Proc Natl Acad Sci U S A 105(32): 11442–114425.
[26]
Kushnerenko E, Tomalski P, Ribeiro H, Potton A, Axelsson EL, et al. (2011) Individual differences in audiovisual speech integration in infants are associated with visual attention to articulation. Under. review.
[27]
Tomalski P, Ribeiro H, Ballieux H, Axelsson E, Murphy E, et al. (2011) Exploring early developmental changes in face scanning patterns during the perception of audio-visual mismatch of speech cues. Under. review.
Paré M, Richler R, ten Hove M, Munhall KG (2003) Gaze behavior in audiovisual speech perception: The influence of ocular fixations on the McGurk effect. Percept Psychophys 65: 553–567.
[30]
Lewis TL, Maurer D (1992) The development of the temporal and nasal visual fields during infancy. Vision Res 32: 903–911.
[31]
Goodman R, Ford T, Richards H, Gatward R, Meltzer H (2000) The Development and Well-Being Assessment: description and initial validation of an integrated assessment of child and adolescent psychopathology. J Child Psychol Psychiatry 41: 645–55.
[32]
Rutter M, Bailey A, Lord C, Berument S K (2003) Social Communication Questionnaire. Los Angeles, Calif: Western Psychological Services.
[33]
Guiraud JA, Kushnerenko E, Tomalski P, Davies K, Ribeiro H, et al. (2011) Differential habituation to repeated sounds in infants at high risk for autism. Neuroreport 22: 845–849.
[34]
Andersen TS, Tiippana K, Laarni J, Kojo I, Sams M (2009) The role of visual spatial attention in audiovisual speech perception. Speech Communication 51: 184–193.
[35]
Hobson RP, Ouston J, Lee A (1988) What’s in a face? The case of autism. Br J Psychol 79: 441–453.
[36]
Jones WBA, Carr KBA, Klin A (2008) Absence of preferential looking to the eyes of approaching adults predicts level of social disability in 2-year-old toddlers with autism spectrum disorder. Arch gen psychiatry 65(8): 946–954.
[37]
Pelphrey KA, Sasson NJ, Reznick JS, Paul G, Goldman BD, et al. (2002) Visual scanning of faces in autism. J Autism Dev Disord 32: 249–261.
[38]
Spezio ML, Adolphs R, Hurley RS, Piven J (2007) Abnormal use of facial information in high-functioning autism. J Autism Dev Disord 37(5): 929–939.
[39]
Dalton KM, Nacewicz DB, Alexander A, Davidson R (2007) Gaze-fixation, brain activation and amygdala volume in unaffected siblings of individuals with autism. Biol. Psychiatry 61(4): 512–520.
[40]
Gibson EJ (1969) Principles of perceptual learning and development. New York: Appleton-Century-Crofts. 537 p.
[41]
Sekiyama K, Tohkura Y (1993) Inter-language differences in the influence of visual cues in speech perception. J Phonetics 21: 427–444.
[42]
Sekiyama K (1997) Cultural and linguistic factors in audiovisual speech processing: the McGurk effect in Chinese subjects. Percept Psychophys 59: 73–80.
[43]
Sekiyama K, Burnham D (2004) Issues in the development of auditory-visual speech perception: Adults, infants, and children. In Interspeech 2004: Eighth International Conference on Spoken Language Processing, Korea.
[44]
Massaro DW, Thompson LA, Barron B, Laren E (1986) Developmental changes in visual and auditory contribution to speech perception. J Exp Child Psychol 41: 93–113.
[45]
Klin A, Jones W, Schultz R, Volkmar F, Cohen D (2002) Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Arch Gen Psychiatry 59: 809–816.
[46]
Townsend J, Harris NS, Courchesne E (1996) Visual attention abnormalities in autism: Delayed orienting to location. J Int Neuropsychol Soc 2: 541–550.
[47]
Zelazo PD, Muller U (2002) Executive function in typical and atypical development. In: Goswami U, editor. Handbook of childhood cognitive development. Oxford: Blackwell.
[48]
Gervais H, Belin P, Boddaert N, Leboyer M, Coez A, et al. (2004) Abnormal cortical voice processing in autism. Nat Neurosci 7: 801–802.
[49]
Desjardins RN, Rogers J, Werker JF (1997) An exploration of why preschoolers perform differently than do adults in audiovisual speech perception tasks. J Exp Child Psychol 66: 85–110.
[50]
Patterson ML, Werker JF (1999) Matching phonetic information in lips and voice is robust in 4.5-month-old infants. Infant Behav Dev 22: 237–247.
[51]
Teinonen T, Aslin RN, Alku P, Csibra G (2008) Visual speech contributes to phonetic learning in 6-month-old infants. Cognition 108: 850–855.
[52]
Loveland KA, Tunali-Kotoski B, Chen R, Brelsford KA (1995) Intermodal perception of affect in persons with autism or down syndrome. Dev Psychopathol 7(3): 409–418.
