All Title Author
Keywords Abstract

Very Slow Search and Reach: Failure to Maximize Expected Gain in an Eye-Hand Coordination Task

DOI: 10.1371/journal.pcbi.1002718

Full-Text   Cite this paper   Add to My Lib


We examined an eye-hand coordination task where optimal visual search and hand movement strategies were inter-related. Observers were asked to find and touch a target among five distractors on a touch screen. Their reward for touching the target was reduced by an amount proportional to how long they took to locate and reach to it. Coordinating the eye and the hand appropriately would markedly reduce the search-reach time. Using statistical decision theory we derived the sequence of interrelated eye and hand movements that would maximize expected gain and we predicted how hand movements should change as the eye gathered further information about target location. We recorded human observers' eye movements and hand movements and compared them with the optimal strategy that would have maximized expected gain. We found that most observers failed to adopt the optimal search-reach strategy. We analyze and describe the strategies they did adopt.


[1]  Gowen E, Miall RC (2006) Eye-hand interactions in tracing and drawing tasks. Hum Mov Sci 25: 568–585. doi: 10.1016/j.humov.2006.06.005
[2]  Ballard DH, Hayhoe MM, Li F, Whitehead SD (1992) Hand–eye coordination during sequential tasks. Philos Trans R Soc Lond B Biol Sci 337: 331–339. doi: 10.1098/rstb.1992.0111
[3]  Binsted G, Chua R, Helsen W, Elliott D (2001) Eye-hand coordination in goal-directed aiming. Hum Mov Sci 20: 563–585. doi: 10.1016/s0167-9457(01)00068-9
[4]  Pelz J, Hayhoe M, Loeber R (2001) The coordination of eye, head, and hand movements in a natural task. Exp Brain Res 139: 266–277. doi: 10.1007/s002210100745
[5]  Hayhoe M, Ballard D (2005) Eye movements in natural behavior. Trends Cogn Sci 9: 188–194. doi: 10.1016/j.tics.2005.02.009
[6]  Blackwell D, Girshick MA (1954) Theory of games and statistical decisions. New York: Wiley.
[7]  von Neumann J, Morgenstern O (1944/1953) Theory of games and economic behavior. Princeton, NJ: Princeton University Press.
[8]  Maloney LT, Zhang H (2010) Decision-theoretic models of visual perception and action. Vision Res 50: 2362–2374. doi: 10.1016/j.visres.2010.09.031
[9]  Najemnik J, Geisler WS (2005) Optimal eye movement strategies in visual search. Nature 434: 387–391. doi: 10.1038/nature03390
[10]  Najemnik J, Geisler WS (2009) Simple summation rule for optimal fixation selection in visual search. Vision Res 49: 1286–1294. doi: 10.1016/j.visres.2008.12.005
[11]  Renninger LW, Verghese P, Coughlan J (2007) Where to look next? Eye movements reduce local uncertainty. J Vis 7: 6, 1–17. doi: 10.1167/7.3.6
[12]  Legge GE, Hooven TA, Klitz TS, Stephen Mansfield J, Tjan BS (2002) Mr. Chips 2002: New insights from an ideal-observer model of reading. Vision Res 42: 2219–2234. doi: 10.1016/s0042-6989(02)00131-1
[13]  Legge GE, Klitz TS, Tjan BS (1997) Mr. Chips: An ideal-observer model of reading. Psychol Rev 104: 524–553. doi: 10.1037/0033-295x.104.3.524
[14]  Trommersh?user J, Landy MS, Maloney LT (2006) Humans rapidly estimate expected gain in movement planning. Psychol Sci 17: 981–988. doi: 10.1111/j.1467-9280.2006.01816.x
[15]  Trommersh?user J, Maloney LT, Landy MS (2003) Statistical decision theory and trade-offs in the control of motor response. Spat Vis 16: 255–275. doi: 10.1163/156856803322467527
[16]  Hudson TE, Maloney LT, Landy MS (2008) Optimal compensation for temporal uncertainty in movement planning. PLoS Comp Biol 4: e10000130. doi: 10.1371/journal.pcbi.1000130
[17]  Battaglia PW, Schrater PR (2007) Humans trade off viewing time and movement duration to improve visuomotor accuracy in a fast reaching task. J Neurosci 27: 6984–6994. doi: 10.1523/jneurosci.1309-07.2007
[18]  Sailer U, Flanagan JR, Johansson RS (2005) Eye-hand coordination during learning of a novel visuomotor task. J Neurosci 25: 8833–8842. doi: 10.1523/jneurosci.2658-05.2005
[19]  Land MF, McLeod P (2000) From eye movements to actions: how batsmen hit the ball. Nat Neurosci 3: 1340–1345.
[20]  Brainard DH (1997) The psychophysics toolbox. Spat Vis 10: 433–436. doi: 10.1163/156856897x00357
[21]  Pelli DG (1997) The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spat Vis 10: 437–442. doi: 10.1163/156856897x00366
[22]  Cornelissen FW, Peters EM, Palmer J (2002) The Eyelink Toolbox: eye tracking with MATLAB and the Psychophysics Toolbox. Behav Res Methods Instrum Comput 34: 613–617. doi: 10.3758/bf03195489
[23]  Berger JO (1985) Statistical decision theory and Bayesian analysis. New York: Springer.
[24]  Kumar M (2007) GUIDe Saccade Detection and Smoothing Algorithm. Technical Report CSTR 2007-03, Stanford University, Stanford 2007.
[25]  Efron B, Tibshirani RJ (1993) An introduction to the Bootstrap. New York: Chapman & Hall.
[26]  Vercher JL, Magenes G, Prablanc C, Gauthier GM (1994) Eye-head-hand coordination in pointing at visual targets: spatial and temporal analysis. Exp Brain Res 99: 507–523. doi: 10.1007/bf00228987
[27]  González-Alvarez C, Subramanian A, Pardhan S (2007) Reaching and grasping with restricted peripheral vision. Ophthalmic Physiol Opt 27: 265–274. doi: 10.1111/j.1475-1313.2007.00476.x
[28]  Schlicht EJ, Schrater PR (2007) Effects of visual uncertainty on grasping movements. Exp Brain Res 182: 47–57. doi: 10.1007/s00221-007-0970-8
[29]  Brenner E, Smeets JBJ (2007) Flexibility in intercepting moving objects. J Vis 7: 1–17. doi: 10.1167/7.5.14
[30]  Chapman CS, Gallivan JP, Wood DK, Milne JL, Culham JC, et al. (2010) Reaching for the unknown: Multiple target encoding and real-time decision-making in a rapid reach task. Cognition 116: 168–176. doi: 10.1016/j.cognition.2010.04.008
[31]  Hudson TE, Maloney LT, Landy MS (2007) Movement planning with probabilistic target information. J Neurophysiol 98: 3034–3046. doi: 10.1152/jn.00858.2007
[32]  Sprague N, Ballard D (2003) Eye movements for reward maximization. Adv Neural Inf Process Syst 16: 1419–1433.
[33]  Ma-Wyatt A, Stritzke M, Trommersh?user J (2010) Eye–hand coordination while pointing rapidly under risk. Exp Brain Res 203: 131–145. doi: 10.1007/s00221-010-2218-2


comments powered by Disqus

Contact Us


微信:OALib Journal