|
|
眼动技术在语言测试研究中的应用现状和展望
|
Abstract:
眼动技术能够真实地记录语言加工活动中即时的眼球运动，将眼动技术应用于语言测试研究，有助于以实验心理学的研究方法为语言测试认知过程提供客观可靠的数据。本文简要介绍了近年国外语言测试研究中眼动技术的应用，相关研究主要关注：考生在测试环境和真实语境中认知过程的相似性，得分考生和失分考生认知过程的差异，特定题型所引发的认知过程，任务模态对考生认知过程的影响以及评分员的认知过程。在此基础上作者从多角度分析了相关研究存在的不足，以期为国内学者从事相关研究提供一定参考。
Eye-tracking technology allows for authentic recordings of participants’ online eye movements. Applying eye-tracking technology into language assessment research will help to provide an ob-jective and reliable data source for studies on cognitive processes by means of experimental psy-chology. This paper offers a brief introduction of the status quo of language assessment research with the use of eye-tracking which mainly focuses on: the similarity of test takers’ cognitive pro-cesses engaged in language testing context and real-life domain, the differences on cognitive pro-cesses of successful and unsuccessful test takers, cognitive processes elicited by particular test format, the influence of test modality on test takers’ cognitive processes and raters’ cognitive pro-cesses. In light of these studies, this paper pinpoints existing limitations from multiple perspectives and intends to provide valuable implications for researchers who are interested in related studies.
| [1] | McCray, G. and Brunfaut, T. (2018) Investigating the Construct Measured b Banked Gap-Fill Items: Evidence from Eye-Tracking. Language Testing, 35, 51-73. https://doi.org/10.1177/0265532216677105 |
| [2] | Batty, A.O. (2014) A Comparison of Video- and Au-dio-Mediated Listening Tests with Many-Facet Rasch Modeling and Differential Distractor Functioning. Language Testing, 32, 3-20. https://doi.org/10.1177/0265532214531254 |
| [3] | Taylor, L. (2013) Introduction. In: Geranpayeh, A. and Taylor, L., Eds., Examining Listening: Research and Practice in Assessing Second Language Listening, Cambridge University Press, Cambridge, 1-35. |
| [4] | Ockey, G.J. (2007) Construct Implications of Including Still Image or Video in Computer-Based Listening Tests. Language Testing, 24, 517-537. https://doi.org/10.1177/0265532207080771 |
| [5] | Wagner, E. (2010) Test Takers’ Interaction with an L2 Video Listening Test. System, 38, 280-291.
https://doi.org/10.1016/j.system.2010.01.003 |
| [6] | Buck, G. (2001) Assessing Listening. Cambridge University Press, Cambridge.
https://doi.org/10.1017/CBO9780511732959 |
| [7] | Wagner, E. (2007) Are They Watching? Test-Taker Viewing Behavior during L2 Video Listening Test. Language Learning and Technology, 11, 67-86. |
| [8] | Suvorov, R. (2015) The Use of Eye-Tracking in Research on Video-Based Second Language (L2) Listening Assessment: A Comparison of Context Videos and Content Videos. Language Testing, 32, 463-483.
https://doi.org/10.1177/0265532214562099 |
| [9] | Bachman, L.F. and Palmer, A.S. (1996) Language Testing in Practice: Designing and Developing Useful Language Tests. Oxford University Press, Oxford. |
| [10] | Knoch, U. (2009) Diagnostic Assessment of Writing: A Comparison of Two Rating Scales. Language Testing, 26, 275-304. https://doi.org/10.1177/0265532208101008 |
| [11] | Barkaoui, K. (2010) Variability in ESL Essay Rating Processes: The Role of the Rating Scale and Rater Experience. Language Assessment Quarterly, 7, 54-74. https://doi.org/10.1080/15434300903464418 |
| [12] | Lumley, T. (2002) Assessment Criteria in A Large-Scale Writing Test: What Do They Really Mean to The Raters? Language Testing, 19, 246-272. https://doi.org/10.1191/0265532202lt230oa |
| [13] | Winke, P. and Lim, H. (2015) ESL Essay Raters’ Cognitive Processes in Applying the Jacobs et al. Rubric: An Eye-Movement Study. Assessing Writing, 25, 38-54. https://doi.org/10.1016/j.asw.2015.05.002 |
| [14] | Baxter, G. and Glaser, R. (1998) Investigating the Cognitive Complexity of Science Assessments. Educational Measurement: Issues and Practices, 17, 37-45. https://doi.org/10.1111/j.1745-3992.1998.tb00627.x |
| [15] | Glaser, R. (1991) Expertise and Assessment. In: Wittrock, M.C. and Taylor, L., Eds., Testing and Cognition, Prentice Hall, Englewood Cliffs, 17-30. |
| [16] | 郭纯洁. 有声思维在外语教学研究中的应用[M]. 北京: 外语教学与研究出版社, 2015. |
| [17] | Green, A. (1998) Verbal Protocol in Language Testing Research. Cambridge University Press, Cambridge. |
| [18] | Bachman, L.F. (1990) Fundamental Considerations in Language Testing. Oxford University Press, Oxford. |
| [19] | Bachman, L.F. (2000) Modern Language Testing at the Turn of the Century: Assuring That What We Count Counts. Language Testing, 17, 1-42. https://doi.org/10.1177/026553220001700101 |
| [20] | 李航. 整体和分项量表的使用对EFL作文评分信度的影响[J]. 外语与外语教学, 2013(2): 45-51. |
| [21] | Field, J. (2012) The Cognitive Validity of the Lecture-Based Questions in the IELTS Academic Listening Paper. In: Taylor, L. and Weir, C.J., Eds., IELTS Collected Papers 2: Research in Reading and Listening Assessment, Cambridge University Press, Cambridge, 391-453. |
| [22] | Purpura, J.E. (2013) Cognition and Language Assessment. In: Kunnan, A.J., Ed., The Companion to Language Assessment, Wiley/Blackwell, Hoboken, 1452-1476. https://doi.org/10.1002/9781118411360.wbcla150 |
| [23] | 刘壮, 韩宝成, 阎彤. 《欧洲语言共同参考框架》的交际语言能力框架和外语教学理念[J]. 外语教学与研究, 2012, 44(4): 616-623. |
| [24] | Kathy, C. and Pellicer-Sánchez, A. (2016) Using Eye-Tracking in Applied Linguistics and Second Language Research. Second Language Research, 32, 453-467. https://doi.org/10.1177/0267658316637401 |
| [25] | Liversedge, S.P., Gilchrist, I.D. and Everling, S. (2011) The Oxford Handbook of Eye-Movement. Oxford University Press, Oxford. https://doi.org/10.1093/oxfordhb/9780199539789.001.0001 |
| [26] | Winke, P.M., Golfroid, A. and Gass, S.M. (2013) Introduction to the Special Issue: Eye-Movement Recordings in Second Language Research. Studies in Second Language Acquisition, 35, 205-212.
https://doi.org/10.1017/S027226311200085X |
| [27] | 闫国利, 白学军. 眼动分析技术的基础与应用[M]. 北京: 北京师范大学出版社, 2018. |
| [28] | Holmqvist, K., Nystr？m, M., Andersson, R., Dewhurst, R., Jarodzka, H. and Van de Weijer, J. (2011) Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford University Press, Ox-ford. |
| [29] | Rayner, K. Reichle, E.D. and Pollastek, A. (2005) Eye Movement Control in Reading and the E-Z Reader Model. In: Underwood, G., Ed., Cognitive Processes in Eye Guidance, Oxford University Press, Oxford, 131-162.
https://doi.org/10.1093/acprof:oso/9780198566816.003.0006 |
| [30] | Rayner, K. (2009) Eye Movements in Reading: Models and Data. Journal of Eye Movement Research, 2, 1-10. |
| [31] | Van Gog, T. and Jarodoza, H. (2013) Eye-Tracking as a Tool to Study and Enhance Cognitive and Metacognitive Processes in Computer-Based Learning Environments. In: Azevedo, R. and Aleven, V., Eds., International Handbook of Metacognition and Learning Technologies, Springer Science + Business Media, New York, 143-156.
https://doi.org/10.1007/978-1-4419-5546-3_10 |
| [32] | Rayner, K. (1998) Eye Movements in Reading and Infor-mation Processing: 20 Years of Research. Psychological Bulletin, 124, 372-422. https://doi.org/10.1037/0033-2909.124.3.372 |
| [33] | Duchowski, A.T. (2002) A Breadth-First Survey of Eye-Tracking Applications. Behavior Research Methods, Instruments, and Computers, 34, 455-470. https://doi.org/10.3758/BF03195475 |
| [34] | 吴迪, 舒华. 眼动技术在阅读研究中的应用[J]. 心理学动态, 2001, 9(4): 319-324. |
| [35] | Just, M.A. and Carpenter, P.A. (1980) A Theory of Reading: From Eye Fixations to Comprehen-sion. Psychological Review, 87, 329-354. https://doi.org/10.1037/0033-295X.87.4.329 |
| [36] | 李清华. 语言测试之效度理论发展五十年[J]. 现代外语, 2006, 29(1): 87-95. |
| [37] | Cohen, A.D. (2006) The Coming of Age of Research on Test-Taking Strategies. Language Assessment Quarterly, 4, 307-331. https://doi.org/10.1080/15434300701333129 |
| [38] | Weir, C.J. (2005) Language Testing and Validation: An Evi-dence-Based Approach. Palgrave Macmillan, London. |
| [39] | Bax, S. and Weir, C.J. (2012) Investigating Learners’ Cognitive Processes during A Computer-Based CAE Reading Text. In: Banerjee, J., Ed., Research Notes: Issues 47, Océ Ltd., London, 3-14. |
| [40] | Purpura, J.E. (1997) An Analysis of the Relationships between Test-Takers’ Cognitive and Metacognitive Strategy Use and Second Language Test Performance. Language Learning, 47, 289-325.
https://doi.org/10.1111/0023-8333.91997009 |
| [41] | Purpura, J.E. (1998) Investigating the Effects of Strategy Use and Second Language Test Performance with High- and Low-Ability Test-Takers: A Structural Equation Modelling Approach. Language Learning, 15, 333-379.
https://doi.org/10.1177/026553229801500303 |
| [42] | Phakiti, A. (2003) A Closer Look at the Relationship of Cog-nitive and Metacognitive Strategy Use to EFL Reading Achievement Test Performance. Language Testing, 20, 26-56. https://doi.org/10.1191/0265532203lt243oa |
| [43] | Phakiti, A. (2007) Strategic Competence and EFL Reading Test Performance. Peter Lang, New York. |
| [44] | Van Gelderen, A., Schoonen, R., De Glopper, L., Hulstijn, J., Simis, A., Snellings, P. and Stevenson, M. (2004) Linguistic Knowledge, Processing Speed, and Metacognitive Knowledge in First- and Second-Language Reading Comprehension: A Componential Analysis. Journal of Educational Psychology, 96, 19-30.
https://doi.org/10.1037/0022-0663.96.1.19 |
| [45] | Bax, S. (2013) The Cognitive Processing of Candidates During Reading Tests: Evidence from Eye-Tracking. Language Testing, 30, 441-465. https://doi.org/10.1177/0265532212473244 |
| [46] | Bachman, L.F. (1985) Performance on Cloze Tests with Fixed-Ratio and Rational Deletions. TESOL Quarterly, 19, 535-556. https://doi.org/10.2307/3586277 |
| [47] | Jonz, J. (1990) Another Turn in the Conversation: What Does Cloze Measure? TESOL Quarterly, 24, 61-83.
https://doi.org/10.2307/3586852 |
| [48] | Alderson, J.C. (1980) Native and Non-Native Speaker Performance on Cloze Tests. Language Learning, 30, 59-76.
https://doi.org/10.1111/j.1467-1770.1980.tb00151.x |
| [49] | Yamashita, J. (2003) Processes of Taking a Gap-Filling Test: Comparison of Skilled and Less Skilled EFL Readers. Language Testing, 20, 267-293. https://doi.org/10.1191/0265532203lt257oa |
| [50] | 邹申, 张文星, 孔菊芳. 《欧洲语言共同参考框架》在中国: 研究现状和应用展望[J]. 中国外语, 2015(3): 24-31. |
| [51] | Brown, J.D. (2013) My Twenty-Five Years of Cloze Testing Research: So What? International Journal of Language Studies, 41, 1-32. |
