[Paper Review] A short review and primer on eye tracking in human computer interaction applications

Kristian Lukander|arXiv (Cornell University)|Sep 23, 2016

Gaze Tracking and Assistive Technology6 references3 citations

TL;DR

This paper serves as a concise primer on eye tracking in human-computer interaction (HCI), emphasizing its use for inferring cognitive states such as mental workload, focus, and fatigue through gaze and ocular movement metrics. It reviews key eye tracking techniques—EOG and video-oculography—and demonstrates how parameters like fixation duration, saccade velocity, blink frequency, and dwell time can be leveraged to model user state in real-world applications.

ABSTRACT

The application of psychophysiologicy in human-computer interaction is a growing field with significant potential for future smart personalised systems. Working in this emerging field requires comprehension of an array of physiological signals and analysis techniques. Eye tracking is a widely used method for tracking user attention with gaze location, but also provides information on the internal cognitive and contextual state, intention, and the locus of the user's visual attention in interactive settings through a number of eye and eyelid movement related parameters. This paper presents a short review on the application of eye tracking in human-computer interaction. This paper aims to serve as a primer for the novice, enabling rapid familiarisation with the latest core concepts. We put special emphasis on everyday human-computer interface applications to distinguish from the more common clinical or sports uses of psychophysiology. This paper is an extract from a comprehensive review of the entire field of ambulatory psychophysiology, including 12 similar chapters, plus application guidelines and systematic review. Thus any citation should be made using the following reference: B. Cowley, M. Filetti, K. Lukander, J. Torniainen, A. Henelius, L. Ahonen, O. Barral, I. Kosunen, T. Valtonen, M. Huotilainen, N. Ravaja, G. Jacucci. The Psychophysiology Primer: a guide to methods and a broad review with a focus on human-computer interaction. Foundations and Trends in Human-Computer Interaction, vol. 9, no. 3-4, pp. 150--307, 2016.

Motivation & Objective

• To provide a rapid, accessible introduction to eye tracking for researchers and practitioners new to psychophysiology in HCI.
• To focus on everyday interactive applications rather than clinical or sports-based uses of eye tracking.
• To highlight the utility of eye movement parameters in inferring internal cognitive and contextual states in real-world settings.
• To bridge the gap between laboratory-based eye tracking research and ecologically valid, real-world HCI applications.
• To support the development of smart, personalized systems by demonstrating how eye tracking can inform user state modeling.

Proposed method

• Utilizes electro-oculography (EOG) for measuring electrical signals from eye muscles, enabling high temporal resolution tracking of eye movements and blinks.
• Employs video-oculography (VOG) using camera-based systems to detect pupil, corneal reflections, and eyelid movements for point-of-gaze (POG) estimation.
• Extracts key ocular metrics: fixation duration, saccade amplitude and velocity, blink frequency and duration, and dwell time within defined areas of interest.
• Applies derived parameters such as gaze path patterns, fixation sequence, and attentional focus indices to assess cognitive engagement and workload.
• Relies on established metrics from prior studies, including saccadic intrusions, micro-saccades, and vergence for depth perception and attention tracking.
• Integrates findings from diverse task contexts (reading, driving, dual-tasking) to validate the cross-task applicability of ocular parameters.

Experimental results

Research questions

• RQ1 How can eye tracking be used to infer mental workload in interactive tasks such as reading or dual-task performance?
• RQ2 What ocular movement parameters best indicate shifts in attentional focus or flow during user interaction?
• RQ3 To what extent can blink rate, saccade velocity, and fixation patterns serve as reliable indicators of fatigue or sleepiness?
• RQ4 How do eye movement metrics vary across different task types (e.g., reading vs. visual search), and what are the implications for generalizability?
• RQ5 What are the practical limitations and opportunities of deploying eye tracking in ecologically valid, real-world HCI environments?

Key findings

• Saccade velocity and frequency of saccadic intrusions are strong indicators of mental workload, with higher cognitive load correlating with faster saccades and increased intrusions.
• Reduced blink frequency and increased fixation concentration are associated with heightened visual task focus, while increased horizontal vergence indicates auditory task engagement.
• Peak saccade velocity has been identified as one of the most powerful oculomotor parameters for detecting sleepiness, with strong correlation to declining cognitive performance.
• Blink duration and amplitude, along with saccade rate and velocity, show significant changes under fatigue, making them reliable markers for sleepiness detection.
• Dwell time on specific interface elements correlates with attention distribution and comprehension, with 'seductive details' causing prolonged fixation and reduced recall.
• Eye-based metrics such as fixation frequency and blink rate can classify cognitive states (e.g., relaxed vs. engaged, alert vs. fatigued) with classification accuracies ranging from 67% to 93%.