[论文解读] Measuring eye-tracking accuracy and its impact on usability in apple vision pro

Zehao Huang, Gancheng Zhu+5 more|arXiv (Cornell University)|Jun 1, 2024

Leaf Properties and Growth Measurement被引用 5

一句话总结

该研究评估 Apple Vision Pro 的眼动追踪在两种测试设置中的准确性，并考察其与可用性之间的关系，平均准确度在大致 34°×18° 的视野内分别为 1.11° 和 0.93°，SUS 可用性评分分别为 75.24 和 68.26，且眼动追踪准确性与可用性之间没有可靠的相关性。

ABSTRACT

With built-in eye-tracking cameras, the recently released Apple Vision Pro (AVP) mixed reality (MR) headset features gaze-based interaction, eye image rendering on external screens, and iris recognition for device unlocking. One of the technological advancements of the AVP is its heavy reliance on gaze- and gesture-based interaction. However, limited information is available regarding the technological specifications of the eye-tracking capability of the AVP, and raw gaze data is inaccessible to developers. This study evaluates the eye-tracking accuracy of the AVP with two sets of tests spanning both MR and virtual reality (VR) applications. This study also examines how eye-tracking accuracy relates to user-reported usability. The results revealed an overall eye-tracking accuracy of 1.11° and 0.93° in two testing setups, within a field of view (FOV) of approximately 34° x 18°. The usability and learnability scores of the AVP, measured using the standard System Usability Scale (SUS), were 75.24 and 68.26, respectively. Importantly, no statistically reliable correlation was found between eye-tracking accuracy and usability scores. These results suggest that eye-tracking accuracy is critical for gaze-based interaction, but it is not the sole determinant of user experience in VR/AR.

研究动机与目标

• 在 MR/VR 场景中评估 Apple Vision Pro 的眼动追踪准确性。
• 使用 SUS 指标量化可用性与可学习性。
• 研究眼动追踪准确性与可用性结果之间的相关性。

提出的方法

• 在 MR 和 VR 场景中进行两组眼动追踪准确性测试。
• 在约 34°×18° 的视场内测量凝视准确性。
• 计算 System Usability Scale (SUS) 评分以评估可用性与可学习性。

实验结果

研究问题

• RQ1 在所测试的 MR/VR 设置中，Apple Vision Pro 的眼动追踪准确性是多少？
• RQ2 据 SUS，Apple Vision Pro 的可用性与可学习性有多高？
• RQ3 眼动追踪准确性与可用性指标之间是否存在统计上可靠的关系？
• RQ4 在任务期间，眼动追踪准确性是否落在设备的工作视场内？

主要发现

• 在一个设置中眼动追踪准确性平均为 1.11°，在另一个设置中为 0.93°，均在 ~34°×18° 的 FOV 内。
• 可用性与可学习性分数（SUS）分别为 75.24 和 68.26。
• 未发现眼动追踪准确性与可用性分数之间存在统计上可靠的相关性。
• 眼动追踪准确性对凝视为基础的交互很重要，但并非决定用户体验的唯一因素。