Oculometer

Oculometer is a device that tracks eye movement.[1][2] The oculometer computes eye movement by tracking corneal reflection relative to the center of the pupil.[3] An oculometer, which can provide continuous measurements in real time, can be a research tool to understand gaze as well as cognitive function. Further, it can be applied for hands-free control.[3] It has applications in flight training,[4] cognitive assessment,[4] disease diagnosis,[5] and treatment.[6] The oculometer relies on the principle that when a collimated light beam is incident on the eye, the direction in which the eye moves is proportional to the position of the reflection of that light beam from the cornea with respect to the center of the pupil.[3] Eye movements can be accurately measured over a linear range of more than 20${\displaystyle ^{\circ }}$  with a resolution of 0.1${\displaystyle ^{\circ }}$.[7]

History

Eye movement and tracking have been studied for centuries, with the very first eye tracking being simple observation of the eyes, by either oneself or another.[4] The first improvement on this occurred in 1738, when an observer would feel the outside of closed eyelids to track eye movement.[4] Next in 1879, an innovation to listen to muscle movements using a kymograph was implemented.[4] Though rudimentary, these early techniques show repeated need throughout history to track eye movements.[4]

The first true eye tracking device was invented by Huey in 1898.[4] To work, this device was required to contact the cornea, which limited its comfort, usability, and generalizability.[4]

It was not until the 20th century that a robust, non-contact, modern eye-tracker came to fruition. This device, called the photocornograph, worked by photographing eye movement based on reflection from the cornea.[4] This device only recorded horizontal movements, until the work of Judd and colleagues in 1905 added both temporal and vertical recording.[4]

Due to the many applications of an eye tracking device to aviators and pilots, NASA and the United States Air Force carried out extensive studies on this technology, propelling the field forward.[4] Much of this took place during the 1970s and 1980s.[4] However even with this extensive research, oculometers remained bulky and technically difficult.[3]

Research-grade oculometers finally received a user-friendly redesign, with commercial devices available as of recently. These low-profile devices can be worn non-intrusively on a pair of eyeglasses.[6]

Advantages

Since the principles governing the workings of the oculometer rely on a relatively simple concept (electro-optical sensing of the eye), it ensures that the oculometer will be functional whenever the user is seeing.[3] Additionally, the position of the reflection of the collimated beam from the cornea can be approximated to be on the plane of the pupil. This implies minimal parallax error between the corneal reflection and the center of the pupil, thus making the oculometer insensitive to changes in the head position during measurements. These properties of the oculometer ensures minimal interference with the routine activities of the user during measurements. It also negates the need for extensive equipment like bite plates or rigid skull clamping for measurements.

Optical components[3]

• Light source: Source of illumination such as cathode ray tube or glow modulator tube
• Filter: light is filtered such that light incident on the eye is near infrared
• Polarizer: light from the source is polarized to capture only true corneal reflections
• Eyepiece: the user looks through an objective lens in an eyepiece, through which the illumination beam travels to irradiate the eye
• Lenses: two collimating lenses
• Beam splitters: one beam splitter directs visible light to the eye, the other directs light to the detector
• Detector: a silicon diode camera records measurements

A schematic of the oculometer, depicting the arrangement of the light source, objective lens, beam splitter, two polarizing lenses, detector, and eyepiece.

General principles

Eye movement can be quantified by reflection off the cornea. However, in this case a movement of the head would also cause a movement to be recorded.[4] This can be overcome by either rigidly fixing the head to prevent any movements, however this is intrusive and uncomfortable for the user and not broadly applicable for human research studies. Or, the entire apparatus could be mounted on the head, which likewise is bulky and uncomfortable. A better solution is to measure two parameters, such as corneal reflection and pupil movement (based on pupil center).[8]

Optical design

The optical design of the oculometer allows normal vision, directs light from a fixed internal source onto the eye of the user, and forms the image of the pupil on a detector.[3] The basic lens design includes a fixed eye piece and an adjustable objective lens followed by 2 beam splitters. The device also consists of a polarization system to polarize the light from the source (typically a glow modulator tube) in the H direction. In order to attenuate the light from the source through reflections in the eyepiece, a linear polarizer in the V direction is placed in the optical path. A quarter wave plate is placed between the eye and the eye piece and rotates the plane of polarization by 90 degrees thus ensuring that the V-polarizer does not attenuate the true corneal reflections.

The light source and detector are aligned coaxially. When the eye moves, the reflection off the cornea is displaced from the pupil center.[8] This displacement is measured by

${\textstyle D=\kappa *sin\theta }$[8]

D is displacement, ${\displaystyle \kappa }$ is the distance from the center of the cornea, ${\displaystyle \theta }$ is the angle of inclination of the eye's optical axis to the oculometer.[8]

Near infrared light (NIR) (approximately 750nm to 2,500nm wavelengths) is used for a few reasons.[8] First, NIR light is less detectable to the human eye than other wavelengths of visible light, so the NIR light beam is less intrusive or noticeable to the user.[8] Second, with this configuration the pupil is backlit, resulting in a bright disc, effectively differentiating the pupil from the rest of the eye and face.[8]

Typically, the oculometer consists of an eyepiece through which the user sees. An alternate design exists where the oculometer is head-mounted. This arrangement does not include the traditional eye-piece and user sees through a transparent, curved visor placed in front of his eyes.

Electronic design

The traditional oculometer operates in two modes: acquisition and tracking modes.[3] When the  user first sees through the eye piece, a rough raster scan captures the black pupil and bright reflections from the cornea.[3] Then, the device automatically switches to tracking mode where time-division-multiplex-scans acquires continuous measurements of eye direction.[3] Eye direction from the time-division-multiplex scans are computed by the superposition of the scan positions of corneal reflection and pupil positions.[3] In case of device malfunction or loss in continuity due to the user blinking their eyes, the device switches back to the acquisition mode until tracking is restored.[3] In recent designs, the acquisition mode has been automated to ensure that the pupil/iris boundary was instantly captures once the user sees through the eye piece.[3] The automation also led to automatic switch to tracking mode after initial acquisition was obtained or after the user blinks.[3]

Applications

Piloting aircraft

There are numerous uses for the oculometer in the field of aviation.[4] One is understanding whether cognitive abilities are sufficient for flight clearance. Further, flight programs can use the oculometer to inform cockpit design in terms of instrumentation panels, by studying the gaze of pilots as they fly.[4] Finally, aviator training has benefitted from the oculometer as well.[4] Understanding how a particular pilot scans through his field of view while flying allows for personalized feedback from flight coaches.[4] It can provide instructors with more information by which to evaluate and further instruct learning pilots. For this reason, NASA and the US Armed Forces have utilized oculometers in their training programs, creating the Oculometer Training Tape Technique in the late 1900s.[4]

NASA

A NASA research project regarding the oculometer was to realize the ability for a person to control a machine using their eyes, which firstly necessitates eye movement measurements. NASA engineered a telescopic oculometer in which a user looks through an eyepiece, and given that the user can see through the eyepiece, eye movements will be measured.[3]

One particular application of NASA's oculometer endeavor is eye control of an Astronaut Maneuvering Unit (AMU).[3] When an astronaut is in space and would like to move, the AMU facilitates this. However, controlling such a unit is no trivial task.[3] Manual/hand controls are difficult as there are many axes and therefore many muscle outputs needed to coordinate 3D movement.[3] However, eye control would be easier to implement with an oculometer.[3]  

Cognitive assessment

Aviation requires robust, sharp cognitive function, and the eye is part of the central nervous system as they are extensions of the brain, linking cognitive function with healthy eye function.[4] Therefore oculometers can function as cognitive assessment tools.[4]

Diagnosis of Parkinson's disease

Abnormal eye movements is an established biomarker for numerous motor diseases including Parkinson's disease.[9] Each motor disease is expected to produce different signature pattern of eye movement abnormalities.[9] Using those eye movement patterns both as a diagnostic tool and for monitoring disease progression has therefore been of scientific interest.[9] Oculometers are therefore used in this area for tracking eye movement.[9] The use of oculometers for diagnosis of motor diseases is promising, though it has not yet been validated in the clinic.[9]

For Parkinson's disease specifically, the signature pattern of eye movement abnormalities occur as horizontal saccades (rapid, conjugate, eye movement that shift the center of the vision field).[5] Patients with Parkinson's disease displayed high inabilities in performing antisaccadic tasks (eye movement in the opposite direction from the onset trigger).[5] Measurement of antisaccades therefore enables scientists to detect early stages of Parkinson's disease.[5] These studies are still in the research phase.[5]

Smart eyeglasses

For this application, the electronic design of the traditional oculometer has been modified to replace complex real-time video processing such that the oculometer could fit on light weight eyeglasses and have relatively long battery life.[6] Smart eyeglasses are used to correct for vision errors due to age-related conditions while restoring normal vision.[6] Smart eyeglasses utilize tunable eyepieces compared to fixed lenses used in conventional glasses.[6]

These glasses work by projecting light from a few different directions using infrared LEDs on the user's eyeball and receives the refracted light from discrete infrared proximity sensors also placed at a few different locations.[6] The use of multiple detectors not only enables oculometers to be used as lightweight wearables but also ensures that signals detected by the sensors are not dependent on external illumination.[6] This property allows the device to be functional in dark conditions.[6] The major disadvantage of the use of sensors compared to continuous video processing is the significant decline in accuracy since measurements are both reduced in frequency and number of measurements.[6]

Other applications

Other potential application of oculometers that are still currently under development include in air traffic control for operators to designate aircraft through eye movement;[10] in laser communication in dynamic situations where operators can transmit signals by looking at the signal; in television systems to monitor the eye direction as it views the television display such that sensory requirements of the eye can be met with lower bandwidths; and in psychological tests to analyze pattern of images that patients tend to avoid.

References

1. Crawford, Daniel; Burdette, Daniel; Capron, William (1994-01-01). "Techniques used for the analysis of oculometer eye-scanning data obtained from an air traffic control display".
2. "LoCO: A Low-Cost Oculometer for Head-mounted Wearable Computer Displays". www.sbir.gov. U.S.: Small Business Innovation Research, United States Government.
3. Merchant, J (July 1, 1967). "The Oculometer". NASA.
4. Vidulich, Michael A.; Tsang, Pamela S. (2019-02-11). Improving Aviation Performance through Applying Engineering Psychology: Advances in Aviation Psychology. CRC Press. ISBN 9780429960147.
5. Antoniades, C. A.; Hu, M.; Kennard, C. (2012-11-01). "Impaired Antisaccades in Parkinson's Disease". Journal of Neurology, Neurosurgery & Psychiatry. 83 (Suppl 2): A10. doi:10.1136/jnnp-2012-304200a.39. ISSN 0022-3050. S2CID 75265389.
6. Mastrangelo, A. S.; Karkhanis, M.; Likhite, R.; Bulbul, A.; Kim, H.; Mastrangelo, C. H.; Hasan, N.; Ghosh, T. (July 2018). "A Low-Profile Digital Eye-Tracking Oculometer for Smart Eyeglasses". 2018 11th International Conference on Human System Interaction (HSI). Vol. 2018. pp. 506–512. doi:10.1109/HSI.2018.8431368. ISBN 978-1-5386-5024-0. PMC 8528137. PMID 34676133. S2CID 52004561.
7. Bach, M.; Bouis, D.; Fischer, B. (1983-09-01). "An accurate and linear infrared oculometer". Journal of Neuroscience Methods. 9 (1): 9–14. doi:10.1016/0165-0270(83)90103-6. ISSN 0165-0270. PMID 6415349. S2CID 6569293.
8. Gale, A. G. (1981-05-01). "An inexpensive oculometer for human factors research". Behavior Research Methods & Instrumentation. 13 (3): 385–388. doi:10.3758/BF03202041. ISSN 1554-3528.
9. Fitzgerald, James J.; Lu, Zhongjiao; Jareonsettasin, Prem; Antoniades, Chrystalina A. (2018). "Quantifying Motor Impairment in Movement Disorders". Frontiers in Neuroscience. 12: 202. doi:10.3389/fnins.2018.00202. PMC 5904266. PMID 29695949.
10. Smyth, Christopher C.; Dominessy, Mary E. (2016-08-06). "Comparing Oculometer and Head-Fixed Reticle with Voice or Switch for Tactical Display Interaction". Proceedings of the Human Factors Society Annual Meeting. 32 (2): 116–120. doi:10.1177/154193128803200225. S2CID 67095431.