Video-based eyetracking methods and algorithms in head-mounted displays

Head pose is utilized to approximate a user\u27s line-of-sight for real-time image rendering and interaction in most of the 3D visualization applications using head-mounted displays (HMD). The eye often reaches an object of interest before the completion of most head movements. It is highly desirable to integrate eye-tracking capability into HMDs in various applications. While the added complexity of an eyetracked-HMD (ETHMD) imposes challenges on designing a compact, portable, and robust system, the integration offers opportunities to improve eye tracking accuracy and robustness. In this paper, based on the modeling of an eye imaging and tracking system, we examine the challenges and identify parametric requirements for video-based pupil-glint tracking methods in an ET-HMD design, and predict how these parameters may affect the tracking accuracy, resolution, and robustness. We further present novel methods and associated algorithms that effectively improve eye-tracking accuracy and extend the tracking range

The influence of eye model parameter variations on simulated eye-tracking outcomes

The simulated data used in eye-tracking-related research has been largely generated using normative eye models with little consideration of how the variations in eye biometry found in the population may influence eye-tracking outcomes. This study investigated the influence that variations in eye model parameters have on the ability of simulated data to predict real-world eye-tracking outcomes. The real-world experiments performed by two pertinent comparative studies were replicated in a simulated environment using a high-complexity stochastic eye model that includes anatomically accurate distributions of eye biometry parameters. The outcomes showed that variations in anterior corneal asphericity significantly influence simulated eye-tracking outcomes of both interpolation and model-based gaze estimation algorithms. Other, more commonly varied parameters such as the corneal radius of curvature and foveal offset angle had little influence on simulated outcomes.

A Review and Analysis of Eye-Gaze Estimation Systems, Algorithms and Performance Evaluation Methods in Consumer Platforms

In this paper a review is presented of the research on eye gaze estimation techniques and applications, that has progressed in diverse ways over the past two decades. Several generic eye gaze use-cases are identified: desktop, TV, head-mounted, automotive and handheld devices. Analysis of the literature leads to the identification of several platform specific factors that influence gaze tracking accuracy. A key outcome from this review is the realization of a need to develop standardized methodologies for performance evaluation of gaze tracking systems and achieve consistency in their specification and comparative evaluation. To address this need, the concept of a methodological framework for practical evaluation of different gaze tracking systems is proposed.Comment: 25 pages, 13 figures, Accepted for publication in IEEE Access in July 201

LIMBUSTRACK: STABLE EYE-TRACKING IN IMPERFECT LIGHT CONDITIONS

We are aware of only one serious effort at development of a cheap, accurate, wearable eye tracker: the open source openEyes project. However, its method of ocular feature detection is such that it is prone to failure in variable lighting conditions. To address this deficiency, we have developed a cheap wearable eye tracker. At the heart of our development are novel techniques that allow operation under variable illumination

High-Accuracy Gaze Estimation for Interpolation-Based Eye-Tracking Methods

This study investigates the influence of the eye-camera location associated with the accuracy and precision of interpolation-based eye-tracking methods. Several factors can negatively influence gaze estimation methods when building a commercial or off-the-shelf eye tracker device, including the eye-camera location in uncalibrated setups. Our experiments show that the eye-camera location combined with the non-coplanarity of the eye plane deforms the eye feature distribution when the eye-camera is far from the eye’s optical axis. This paper proposes geometric transformation methods to reshape the eye feature distribution based on the virtual alignment of the eye-camera in the center of the eye’s optical axis. The data analysis uses eye-tracking data from a simulated environment and an experiment with 83 volunteer participants (55 males and 28 females). We evaluate the improvements achieved with the proposed methods using Gaussian analysis, which defines a range for high-accuracy gaze estimation between −0.5∘ and 0.5∘. Compared to traditional polynomial-based and homography-based gaze estimation methods, the proposed methods increase the number of gaze estimations in the high-accuracy range

Eye tracking based navigation for proton beam therapy

Cancers of the eye, so-called ocular tumors, are a severe disease that may lead to blindness or even death if left untreated. A possibility to remove the tumor from the body of the patient is a so-called enucleation surgery, the removal of the eye. However, it is a drastic action and oncologists usually try to avoid it. Another treatment option is the therapy with protons. The actual proton therapy to treat ocular tumors is very successful and non-invasive. However, the navigation method that is applied for this kind of therapy requires a pre-treatment surgery, where radio-opaque clips are sutured onto the affected eyeball. These clips are used during the actual treatment to align the diseased eye with two orthogonal X-ray units. Hence, the overall treatment is invasive. The work at hand presents an alternative, completely non-invasive navigation method based on eye tracking technology. We present a new treatment scheme with a first eye tracking prototype integrated into the treatment facility at Paul Scherrer Institute (PSI). This system together with a patient specific eye model enables the medical physicist to align the patient’s eye such that the tumor gets accurately treated by the proton beam. Further, we present a second, improved eye tracking system. This time, we propose a stereo eye tracker, which only uses one physical camera to save physical space. We combine a stereo eye tracking algorithm with a clever arrangement of two planar mirrors and a single camera to get high accuracy, precision, and a compact design altogether. Finally, we present a method to quantitatively evaluate the proposed navigation system. Verifying the accuracy of the location estimate of a volunteer’s eye center is not easily possible. This is because the eye center is an intangible point, that does not correspond to an anatomical structure. Our evaluation method is based on an eye phantom on microstages and a corresponding kinematic model. Our research and development may lead to an ocular tumor treatment which will be safer, more cost-effective, and more accessible to patients suffering from this serious disease