The present study compared the semantic processing of pictures and words by dyslexics to that of typical readers utilizing the electro-physiological (ERP) technique during a semantic categorization decision task. ERPs of 40 university students, 20 typical readers and 20 dyslexic readers were recorded while they participated in a categorization decision task. The subjects were presented with two kinds of stimuli—words and pictures. Results revealed longer reaction times in response to words as compared to pictures in both groups. Electrophysiological measures revealed differences in amplitudes and latencies of ERP components in addition to differences in the mean activity. The results illustrated that the differences between processing words and processing pictures were manifested in timing and in the brain areas involved in the tasks. It also illustrated that although dyslexic and typical readers displayed equal ability to read and understand familiar words, dyslexics could not perform as quickly as typical readers. The semantic domain may be one of the compensatory mechanisms which help compensated dyslexic readers reach and succeed in the higher education system.
References
[1]
Bar, M., & Neta, M. (2006). Humans Prefer Curved Visual Objects. Psychological Science, 17, 645-648. https://doi.org/10.1111/j.1467-9280.2006.01759.x
[2]
Barrett, S. E., & Rugg, M. D. (1990). Event-Related Potentials and the Semantic Matching of Pictures. Brain and Cognition, 14, 201-212. https://doi.org/10.1016/0278-2626(90)90029-N
[3]
Bentin, S., Mouchetant-Rostaing, Y., Giard, M. H., Echallier, J. F., & Pernier, J. (1999). ERP Manifestation of Processing Printed Words at Different Psycholinguistic Levels: Time Course and Scalp Distribution. Journal of Cognitive Neuroscience, 11, 235-260. https://doi.org/10.1162/089892999563373
[4]
Berends, I. E., & Reitsma, P. (2006). Addressing Semantics Promotes the Development of Reading Fluency. Applied Psycholinguistics, 27, 247-265. https://doi.org/10.1017/S0142716406060279
[5]
Brandeis, D., Vitacco, D., & Steinhausen, H. C. (1994). Mapping Brain Electric Micro-States in Dyslexic Children during Reading. Acta Paedopsychiatrica, 56, 239-247.
[6]
Breznitz, Z. (2008). Literacy Studies: Perspectives from Cognitive Neurosciences, Linguistics, Psychology and Education: Brain Research in Language. New York, London: Springer.
[7]
Bruck, M. (1998). Outcomes of Adults with Childhood Histories of Dyslexia. In C. Hulme, & Malatesha (Eds.), Reading and Spelling: Development and Disorders (pp. 179-200). Mahwah, NJ: Erlbaum.
[8]
Brunswick, N., McCrory, E., Price, C. J., Frith, C. D., & Frith, U. (1999). Explicit and Implicit Processing of Words and Pseudowords by Adult Developmental Dyslexics. Brain, 122, 1901-1917. https://doi.org/10.1093/brain/122.10.1901
[9]
Caramazza, A., Hillis, A. E., Rapp, B. C., & Romani, C. (1990). The Multiple Semantic Hypothesis: Multiple Confusion? Cognitive Neuropsychology, 7, 161-189. https://doi.org/10.1080/02643299008253441
[10]
Center for Psychometric Tests (1994). Comprehension Test, Israeli Psychometric Scholastic Aptitude Test. Tel Aviv: Center for Psychometric Tests.
[11]
Coch, D., Maron, L., Wolf, M., & Holcomb, P. J. (2002). Word and Picture Processing in Children: An Event-Related Potential Study. Developmental Neuropsychology, 22, 373-406. https://doi.org/10.1207/S15326942dn2201_3
[12]
Dehaene, S. (1995). Electrophysiological Evidence for Category-Specific Word Processing in the Normal Human Brain. Neuroreport, 6, 2153-2157. https://doi.org/10.1097/00001756-199511000-00014
[13]
Federmeier, K. D., & Kutas, M. (2001). Meaning and Modality: Influences of Context, Semantic Memory Organization, and Perceptual Predictability on Picture Processing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 27, 202-224. https://doi.org/10.1037/0278-7393.27.1.202
[14]
Friedrich, M., & Friederici, A. D. (2004). N400-Like Semantic Incongruity Effect in 19-Month-Old: Processing Known Words in Picture Context. Journal of Cognitive Neuroscience, 16, 1465-1477. https://doi.org/10.1162/0898929042304705
[15]
Ganis, G., Kutas, M., & Sereno, M. I. (1996). The Search for “Common Sense”: An Electrophysiological Study of the Comprehension of Words and Pictures in Reading. Journal of Cognitive Neuroscience, 8, 89-106. https://doi.org/10.1162/jocn.1996.8.2.89
[16]
Grainger, J. (2008). Cracking the Orthographic Code: An Introduction. Language and Cognitive Processes, 23, 1-35. https://doi.org/10.1080/01690960701578013
[17]
Gratton, G., Coles, M. G. H., & Donchin, E. (1983). A New Method for Off-Line Removal of Ocular Artifact. Electroencephalography and Clinical Neurophysiology, 55, 468-484. https://doi.org/10.1016/0013-4694(83)90135-9
[18]
Guenther, R. K, Klatzky, R. L., & Putnam, W. (1980). Commonalities and Differences in Semantic Decisions about Pictures and Words. Journal of Verbal Learning and Verbal Behavior, 19, 54-74. https://doi.org/10.1016/S0022-5371(80)90524-1
[19]
Harmony, T., Fernandez, T., Fernandez-Bouzas, A., Silva-Pereyra, J., Bosch, J., Diaz-Comas, L., & Galan, L. (2001). EEG Changes during Word and Figure Categorization. Clinical Neurophysiology, 112, 1486-1498. https://doi.org/10.1016/S1388-2457(01)00582-X
[20]
Helenius, P., Salmelin, R., Service, E., & Connolly, J. F. (1999). Semantic Cortical Activation in Dyslexic. Journal of Cognitive Neuroscience, 11, 535-550. https://doi.org/10.1162/089892999563599
[21]
Hockley, W. E. (2008). The Picture Superiority Effect in Associative Recognition. Memory and Cognition, 36, 1351-1359. https://doi.org/10.3758/MC.36.7.1351
[22]
Hogaboam, T. W., & Pellegrino, J. W. (1978). Hunting for Individual Differences in Cognitive Processes: Verbal Ability and Semantic Processing of Pictures and Words. Memory & Cognition, 6, 189-193. https://doi.org/10.3758/BF03197445
[23]
Intraub, H. (1981). Rapid Conceptual Identification of Sequentially Presented Pictures. Journal of Experimental Psychology: Human Perception and Performance, 7, 604-610. https://doi.org/10.1037/0096-1523.7.3.604
[24]
Intraub, H., & Nicklos, S. (1985). Levels of Processing and Picture Memory: The Physical Superiority Effect. Journal of Experimental Psychology: Learning, Memory & Cognition, 11, 284-298. https://doi.org/10.1037/0278-7393.11.2.284
[25]
Key, A. P. F., Dove, G. O., & Maguire, M. J. (2005). Linking Brainwaves to the Brain: An ERP Primer. Developmental Neuropsychology, 27, 183-215. https://doi.org/10.1207/s15326942dn2702_1
[26]
Khateb, A., Michel, C. M., Pegna, A. J., O’Dochartaigh, S. D., Landis, T., & Annoni, J. M. (2003). Processing of Semantic Categorical and Associative Ralations: An ERP Mapping Study. International Journal of Psychophysiology, 49, 41-55. https://doi.org/10.1016/S0167-8760(03)00076-X
[27]
Khateb, A., Pegna, A. J., Landis, T., Mouthon, M. S., & Annoni, J. M. (2010). On the Origin of the N400 Effects: An ERP Waveform and Source Localization Analysis in Three Matching Tasks. Brain Topography, 23, 311-320. https://doi.org/10.1007/s10548-010-0149-7
[28]
Kiefer, M. (2001). Perceptual and Semantic Sources of Category-Specific Effects: Event-Related Potentials during Picture and Word Categorization. Memory & Cognition, 29, 100-116. https://doi.org/10.3758/BF03195745
[29]
Kutas, M., & Federmeier, K. D. (2000). Electrophysiology Reveals Semantic Memory Use in Language Comprehension. Trends in Cognitive Sciences, 4, 463-470. https://doi.org/10.1016/S1364-6613(00)01560-6
[30]
Lebovitz, L. (2008). Processing Meaning from Printed Words: Do Dyslexic and Regular Readers Follow Similar Patterns of Pre-Semantic Processing? Thesis for the Master degree, Haifa: University of Haifa.
[31]
Lyon, G. R., Shaywitz, S. E., & Shaywitz, B. A. (2003). A Definition of Dyslexia. Ann Dyslexia, 53, 1-14. https://doi.org/10.1007/s11881-003-0001-9
[32]
Mayseless, N. (2007). Brain Pattern Activity of Regular Readers as Compared to Dyslexic Readers during the Processing of Objects and Pseudo Objects. Thesis the Master degree, Haifa: University of Haifa.
[33]
McBride, D. M., & Dosher, B. A. (2002). A Comparison of Conscious and Automatic Memory Processes for Picture and Word Stimuli: A Process Dissociation Analysis. Consciousness and Cognition, 11, 423-460. https://doi.org/10.1016/S1053-8100(02)00007-7
[34]
Miller-Shaul, S. (2005). The Characteristics of Young and Adult Dyslexics Readers on Reading and Reading Related Cognitive Tasks as Compared to Normal Readers. Dyslexia, 11, 132-151. https://doi.org/10.1002/dys.290
[35]
Nelson, D. L. (1979). Remembering Pictures and Words: Appearance, Significance, and Name. In L. S. Cermak, & F. I. M. Craik (Eds.), Levels of Processing in Human Memory (pp. 45-75). Hillsdale, NJ: Erlbaum.
[36]
Nelson, D. L., Reed, V. S., & McEvoy, C. L. (1976). Learning to Order Pictures and Words: A Model of Sensory and Semantic Encoding. Journal of Experimental Psychology: Human Learning & Memory, 3, 485-497. https://doi.org/10.1037/0278-7393.3.5.485
[37]
Neville, H. J., Coffey, S. A., Holocomb, P. J., & Tallal, P. (1993). The Neurobiology of Sensory and Language Processing in Language-Impaired Children. Journal of Cognitive Neuroscience, 5, 235-253. https://doi.org/10.1162/jocn.1993.5.2.235
[38]
Olofsson, J. K., Nordin, S., Sequeira, H., & Polich, J. (2008). Affective Picture Processing: An Integrative Review of ERP Findings. Biological Psychology, 77, 247-265. https://doi.org/10.1016/j.biopsycho.2007.11.006
[39]
Paivio, A. (1991). Dual Coding Theory: Retrospect and Current Status. Canadian Journal of Psychology, 45, 255-287. https://doi.org/10.1037/h0084295
[40]
Paivio, A., & Csapo, K. (1973). Picture Superiority in Free Recall: Imagery or Dual Coding? Cognitive Psychology, 5, 176-206. https://doi.org/10.1016/0010-0285(73)90032-7
[41]
Pobric, G, Jefferies, E., & Lambon Ralph, M. A. (2010). Amodal Semantic Representations Depend on Both Anterior Temporal Lobes: Evidence from Repetitive Transcranial Magnetic Stimulation. Neuropsychologia, 48, 1336-1342. https://doi.org/10.1016/j.neuropsychologia.2009.12.036
[42]
Rogers, T. T., Lambon Ralph, M. A., Garrard, P., Bozeat, S., McClelland, J. L., & Hodges, J. R. (2004). The Structure and Deterioration of Semantic Memory: A Neuropsychological and Computational Investigation. Psychological Review, 111, 205-235. https://doi.org/10.1037/0033-295X.111.1.205
[43]
Rossion, B., Joyce, C. A., Cottrell G. W., & Tarr, M. J. (2003). Early Lateralization and Orientation Tuning for Face, Word and Object Processing in the Visual Cortex. Neuroimage, 20, 1609-1624. https://doi.org/10.1016/j.neuroimage.2003.07.010
[44]
Russeler, J., Becker, P., Johannes, S., & Munte, F. (2007). Semantic, Syntactic, and Phonological Processing of Written Words in Adult Developmental Dyslexic Readers: An Event-Related Brain Potential Study. BMC Neuroscience, 8, 1-10. https://doi.org/10.1186/1471-2202-8-52 http://www.biomedcentral.com/1471-2202/8/52
[45]
Russeler, J., Probst, S., Johannes, S., & Munte, T. (2003). Recognition Memory for High and Low Frequency Words in Adult Normal and Dyslexic Readers: An Event Related Brain Potential Study. Journal of Clinical and Experimental Neuropsychology, 25, 815-829. https://doi.org/10.1076/jcen.25.6.815.16469
[46]
Shallice, T. (1988). Specialization within the Semantic System. Cognitive Neuropsychology, 5, 133-142. https://doi.org/10.1080/02643298808252929
[47]
Shatil, E. (1995). One-Minute Test for Pseodowords. Unpublished Test, Haifa: University of Haifa.
[48]
Shaul, S. (2005). The Characteristics of Young and Adult Readers on Reading and Reading Related Cognitive Tasks as Compared to Normal Readers. Dyslexia, 11, 132-151. https://doi.org/10.1002/dys.290
[49]
Shaul, S. (2008). Event-Related Potentials (ERPS) in the Study of Dyslexia. In Z. Breznitz (Ed.), Literacy Studies: Perspectives from Cognitive Neurosciences, Linguistics, Psychology and Education: Brain Research in Language. New York, London: Springer. https://doi.org/10.1007/978-0-387-74980-8_2
[50]
Shaywitz, S. E., Shaywitz, B. A., Fulbright, R. K., Skudlarski, P., Mencl, W. E., Constable, R. T., Pugh, K. R., Holahan, J. M., Marchione, K. E., Fletcher, J. M., Lyon, G. R., & Gore, J. C. (2003). Neural Systems for Compensation and Persistence: Young Adult Outcome of Childhood Reading Disability. Biological Psychiatry, 54, 25-33. https://doi.org/10.1016/S0006-3223(02)01836-X
[51]
Snodgrass, J. G., & McCullogh, B. (1986). The Role of Visual Similarity in Picture Categorization. Journal of Experimental Psychology: Learning, Memory and Cognition, 12, 147-154. https://doi.org/10.1037/0278-7393.12.1.147
[52]
Snowling, M., Bishop, D., & Stothard, S. (2000). Is Preschool Language Impairment a Risk Factor for Dyslexia in Adolescence? The Journal of Child Psychology and Psychiatry, 41, 587-600. https://doi.org/10.1111/1469-7610.00651
[53]
Vandenberghe, R., Price, C., Wise, R., Josephs, O., & Frackowiak, R. S. J. (1996). Functional Anatomy of Common Semantic System for Words and Pictures. Nature, 383, 254-256. https://doi.org/10.1038/383254a0
[54]
Visser, M., Jefferies, E., & Lambon Ralph, M. A. (2009). Semantic Processing in the Anterior Temporal Lobes: A Meta-Analysis of the Functional Neuroimaging Literature. Journal of Cognitive Neuroscience, 22, 1083-1094. https://doi.org/10.1162/jocn.2009.21309
[55]
Wechsler, D. (1981). Wechsler Intelligence Scale for Adults-Revised. Cleveland, OH: Psychological Corp.
[56]
Yum, Y. N., Holcomb, P. J., & Grainger, J. (2011). Words and Pictures: An Electrophysiological Investigation of Domain Specific Processing in Native Chinese and English Speakers. Neuropsychology, 10, 1-13.
