Evaluating 3D gaze tracking in virtual space: A computer graphics approach

  • Sunu Wibirama, Hanung A. Nugroho, Kazuhiko Hamamoto
  • Entertainment Computing, June 2017, Elsevier
  • DOI: 10.1016/j.entcom.2017.04.003

Knowing what you see in virtual space: a new approach to evaluating 3D gaze tracking.

What is it about?

Gaze tracking is a system that estimates where an individual​ gaze at a particular scene or a specific object of interest. Gaze tracking has been used for various applications, including interactive pointing in the virtual environment or real-time control of wheelchairs and robots. In the virtual environment, accurate and intuitive estimation of the 3D point of gaze is essential. Evaluation of the 3D point of gaze in virtual space should be validated experimentally. This paper is about designing and developing a new evaluation method for 3D gaze tracking in virtual space. We have implemented computer graphics technology to create virtual plane containing virtual 3D object as validation target. Experimental results show that the proposed evaluation method was able to support real experiment by proving the accuracy of a 3D gaze tracking system with an average Euclidean error less than 1 cm out of 74 cm depth of workspace. The proposed method even can be implemented when space of experiment room is limited by adjusting the distance of virtual plane programmatically.

Why is it important?

Foveated rendering and gaze tracking in VR ---------------------- Our approach is useful for researchers of human-computer interaction field, particularly whom working in virtual reality and gaze-based interaction. Nowadays, VR is going to be more realistic since the 3D content is presented with foveated rendering. For example, Nvidia recently developed a method to render with high resolution only a specific location where the user looks at, while the other parts of the scene were rendered with lower resolution. This foveated rendering technology--hi-res rendering a specific location where the user gazes at--is mainly based on gaze tracking technology. Unfortunately, accurate estimation of the 3D point of gaze is needed to associate what the user look at with the true location where the user looks at. Our method can be used as an alternative approach to validate the 3D gaze tracking system in VR.


Dr.Eng. Sunu Wibirama
Universitas Gadjah Mada

If you are working in the visualization field or computer graphics research area, you may be interested in our paper. This paper shows you how to use computer graphics in a more applied field: human-computer interaction. Results of the paper is actually a preliminary work towards our latest research. Check this Kudos page: https://goo.gl/5fYHBj

Read Publication


The following have contributed to this page: Dr.Eng. Sunu Wibirama