All Title Author
Keywords Abstract

Sensors  2013 

Remote Gaze Tracking System on a Large Display

DOI: 10.3390/s131013439

Keywords: remote gaze tracking, large display, WVC and NVC, panning and tilting

Full-Text   Cite this paper   Add to My Lib


We propose a new remote gaze tracking system as an intelligent TV interface. Our research is novel in the following three ways: first, because a user can sit at various positions in front of a large display, the capture volume of the gaze tracking system should be greater, so the proposed system includes two cameras which can be moved simultaneously by panning and tilting mechanisms, a wide view camera (WVC) for detecting eye position and an auto-focusing narrow view camera (NVC) for capturing enlarged eye images. Second, in order to remove the complicated calibration between the WVC and NVC and to enhance the capture speed of the NVC, these two cameras are combined in a parallel structure. Third, the auto-focusing of the NVC is achieved on the basis of both the user’s facial width in the WVC image and a focus score calculated on the eye image of the NVC. Experimental results showed that the proposed system can be operated with a gaze tracking accuracy of ±0.737°~±0.775° and a speed of 5~10 frames/s.


[1]  Lee, H.C.; Luong, D.T.; Cho, C.W.; Lee, E.C.; Park, K.R. Gaze tracking system at a distance for controlling IPTV. IEEE Trans. Consum. Electron. 2010, 56, 2577–2583.
[2]  Vizio Adds IPTV Connectivity to Its HDTV Line. Available online: (accessed on 20 June 2013).
[3]  Cho, C.W.; Lee, J.W.; Shin, K.Y.; Lee, E.C.; Park, K.R.; Lee, H.; Cha, J. Gaze detection by wearable eye-tracking and NIR LED-based head-tracking device based on SVR. ETRI J. 2012, 34, 542–552.
[4]  Heo, H.; Lee, E.C.; Park, K.R.; Kim, C.J.; Whang, M. A realistic game system using multi-modal user interfaces. IEEE Trans. Consum. Electron. 2010, 56, 1364–1372.
[5]  Bang, J.W.; Lee, E.C.; Park, K.R. New computer interface combining gaze tracking and brainwave measurements. IEEE Trans. Consum. Electron. 2011, 57, 1646–1651.
[6]  Ko, Y.J.; Lee, E.C.; Park, K.R. A robust gaze detection method by compensating for facial movements based on corneal specularities. Pattern Recognit. Lett. 2008, 29, 1474–1485.
[7]  Cho, C.W.; Lee, J.W.; Lee, E.C.; Park, K.R. Robust gaze-tracking method by using frontal-viewing and eye-tracking cameras. Opt. Eng. 2009, 48, doi:10.1117/1.3275453.
[8]  Chaudhuri, P.; Papagiannakis, G.; Magnenat-Thalmann, N. Camera-Based Gaze Control for Virtual Characters. Proceedings of the 4th International Conference on Enactive Interfaces, Grenoble, France, 19–24 November 2007; pp. 53–60.
[9]  Piccardi, L.; Noris, B.; Barbey, O.; Billard, A.; Schiavone, G.; Keller, F.; von Hofsten, C. Wearcam: A Head Mounted Wireless Camera for Monitoring Gaze Attention and for the Diagnosis of Developmental Disorders in Young Children. Proceedings of the 16th IEEE International Symposium on Robot and Human interactive Communication, Jeju, Korea, 26–29 August 2007; pp. 594–598.
[10]  Lu, H.-C.; Fang, G.-L.; Wang, C.; Chen, Y.-W. A novel method for gaze tracking by local pattern model and support vector regressor. Signal Process. 2010, 90, 1290–1299.
[11]  Yamazoe, H.; Utsumi, A.; Yonezawa, T.; Abe, S. Remote Gaze Estimation with a Single Camera Based on Facial-Feature Tracking without Special Calibration Actions. Proceedings of the 2008 Symposium on Eye Tracking Research & Applications, Savannah, GA, USA, 25–27 March 2008; pp. 245–250.
[12]  Zhu, Z.; Ji, Q. Eye and gaze tracking for interactive graphic display. Mach. Vis. Appl. 2004, 15, 139–148.
[13]  Shih, S.-W.; Liu, J. A novel approach to 3-D gaze tracking using stereo cameras. IEEE Trans. Syst. Man Cybern. B 2004, 34, 234–245.
[14]  Murphy-Chutorian, E.; Doshi, A.; Trivedi, M.M. Head Pose Estimation for Driver Assistance Systems: A Robust Algorithm and Experimental Evaluation. Proceedings of the IEEE Conference on Intelligent Transportation Systems, Bellevue, GA, USA, 30 September–3 October 2007; pp. 709–714.
[15]  Model, D.; Eizenman, M. User-Calibration-Free Remote Eye-Gaze Tracking System with Extended Tracking Range. Proceedings of the 24th Canadian Conference on Electrical and Computer Engineering, Niagara Falls, ON, Canada, 8–11 May 2011; pp. 1268–1271.
[16]  Poitschke, T.; Bay, E.; Laquai, F.; Rigoll, G.; Bardins, S.; Bartl, K.; Vockeroth, J.; Schneider, E. Using Liquid Lenses to Extend the Operating Range of a Remote Gaze Tracking System. Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, San Antonio, TX, USA, 11–14 October 2009; pp. 1250–1254.
[17]  Tobbi T60XL Eye Tracker. Available online: (accessed on 20 June 2013).
[18]  VT2 XL. Available online: (accessed on 20 June 2013).
[19]  RED500. Available online: (accessed on 20 June 2013).
[20]  Turner, J.; Alexander, J.; Bulling, A.; Schmidt, D.; Gellersen, H. Eye Pull, Eye Push: Moving Objects between Large Screens and Personal Devices with Gaze and Touch. Proceedings of the Human-Computer Interaction (INTERACT), Cape Town, South Africa, 2–6 September 2013; pp. 170–186.
[21]  Cho, D.-C.; Yap, W.-S.; Lee, H.; Lee, I.; Kim, W.-Y. Long range eye gaze tracking system for a large screen. IEEE Trans. Consum. Electron. 2012, 58, 1119–1128.
[22]  Lee, H.; Lim, S.Y.; Lee, I.; Cha, J.; Cho, D.-C.; Cho, S. Multi-modal user interaction method based on gaze tracking and gesture recognition. Signal Process. Image Commun. 2013, 28, 114–126.
[23]  Corcoran, P.M.; Nanu, F.; Petrescu, S.; Bigioi, P. Real-time eye gaze tracking for gaming design and consumer electronics systems. IEEE Trans. Consum. Electron. 2012, 58, 347–355.
[24]  Hennessey, C.; Fiset, J. Long Range Eye Tracking: Bringing Eye Tracking into the Living Room. Proceedings of the Symposium on Eye Tracking Research and Applications, Santa Barbara, CA, USA, 28–30 March 2012; pp. 249–252.
[25]  Zhang, Y.; Bulling, A.; Gellersen, H. SideWays: A Gaze Interface for Spontaneous Interaction with Situated Displays. Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, Paris, France, 27 April–2 May 2013; pp. 851–860.
[26]  Mardanbegi, D.; Hansen, D.W. Mobile Gaze-Based Screen Interaction in 3D Environments. Proceedings of the Conference on Novel Gaze-Controlled Applications, Karlskrona, Sweden, 25–26 May 2011.
[27]  Daugman, J. How iris recognition works. IEEE Trans. Circ. Syst. Vid. 2004, 14, 21–30.
[28]  Webcam C600. Available online: (accessed on 20 June 2013).
[29]  Viola, P.; Jones, M.J. Robust real-time face detection. Int. J. Comput. Vis. 2004, 57, 137–154.
[30]  Boyle, M. The Effects of Capture Conditions on the CAMSHIFT Face Tracker; Department of Computer Science, University of Calgary: Calgary, AB, Canada, 2001.
[31]  Lee, W.O.; Lee, H.C.; Cho, C.W.; Gwon, S.Y.; Park, K.R.; Lee, H.; Cha, J. Auto-focusing method for remote gaze tracking camera. Opt. Eng. 2012, 51, doi:10.1117/1.OE.51.6.063204.
[32]  Trucco, E.; Verri, A. Introductory Techniques for 3-D Computer Vision; Prentice Hall PTR: Upper Saddle River, NJ, USA, 1998; pp. 154–196.
[33]  Jung, H.G.; Jo, H.S.; Park, K.R.; Kim, J. Coaxial optical structure for iris recognition from a distance. Opt. Eng. 2011, 50, doi:10.1117/1.3582850.
[34]  Subbarao, M.; Choi, T.-S.; Nikzad, A. Focusing techniques. Opt. Eng. 1993, 32, 2824–2836.
[35]  Kang, B.J.; Park, K.R. A robust eyelash detection based on iris focus assessment. Pattern Recognit. Lett. 2007, 28, 1630–1639.
[36]  Kim, B.-S.; Lee, H.; Kim, W.-Y. Rapid eye detection method for non-glasses type 3D display on portable devices. IEEE Trans. Consum. Electron. 2010, 56, 2498–2505.
[37]  Gonzalez, R.C.; Woods, R.E. Digital Image Processing, 2nd ed. ed.; Prentice Hall Inc.: Upper Saddle River, NJ, USA, 2002.
[38]  Lee, J.W.; Cho, C.W.; Shin, K.Y.; Lee, E.C.; Park, K.R. 3D gaze tracking method using Purkinje images on eye optical model and pupil. Opt. Lasers Eng. 2011, 50, 736–751.
[39]  Yoo, D.H.; Chung, M.J. A novel non-intrusive eye gaze estimation using cross-ratio under large head motion. Comput. Vis. Image Underst. 2005, 98, 25–51.
[40]  Patriot. Available online: (accessed on 20 June 2013).


comments powered by Disqus