Split-Cadence Eye Tracking

Smart overview of the Invention

Split-cadence eye tracking technology is designed to enhance gaze estimation accuracy and efficiency in devices such as head-mounted displays (HMDs) used in extended reality (XR) applications. This method employs a dual pipeline approach: a lower-cadence pipeline estimates the eye's five degrees of freedom (DoF) position relative to the device, while a higher-cadence pipeline focuses on the eye's two DoF rotation. This system optimizes eye tracking by using different lighting techniques to capture necessary image data, thereby improving performance and reducing power consumption.

Background

Extended reality systems integrate virtual content with real-world views, enhancing user experiences in applications like gaming, training, and media consumption. Accurate eye tracking is crucial for these systems, as it allows for precise interaction with virtual environments. Traditional eye tracking methods rely on solving the five DoF estimation problem for every frame, which can be computationally intensive and challenging in compact devices like glasses-type HMDs.

Methodology

The split-cadence approach divides the eye tracking process into two distinct pipelines. The lower-cadence pipeline establishes a reference frame by estimating the eye's full five DoF position, while the higher-cadence pipeline continuously tracks the eye's two DoF rotation. This method assumes that the eye's position relative to the device remains stable over time, allowing for efficient and rapid gaze tracking with reduced computational demands.

Implementation

By leveraging different lighting techniques, the split-cadence system reduces power consumption and enhances image capture quality. The high-cadence pipeline uses specular lighting to capture glint data, while the low-cadence pipeline employs diffuse lighting to capture detailed pupil and iris features. This approach not only optimizes the eye tracking process but also aligns with the architectural constraints of compact wearable devices.

Benefits

The split-cadence eye tracking method offers significant advantages in terms of performance and resource efficiency. It enables rapid and accurate gaze estimation with minimal latency, making it ideal for applications in XR systems and other eye tracking technologies. By addressing the limitations of traditional methods, this approach provides a robust solution that meets the demands of modern wearable devices.