Eye tracking systems have greatly improved in recent years, being a viable and affordable option as digital communication channel, especially for people lacking fine motor skills. Using eye tracking as an input method is challenging due to accuracy and ambiguity issues, and therefore research in eye gaze interaction is mainly focused on better pointing and typing methods. However, these methods eventually need to be assimilated to enable users to control application interfaces. A common approach to employ eye tracking for controlling application interfaces is to emulate mouse and keyboard functionality. We argue that the emulation approach incurs unnecessary interaction and visual overhead for users, aggravating the entire experience of gaze-based computer access. We discuss how the knowledge about the interface semantics can help reducing the interaction and visual overhead to improve the user experience. Thus, we propose the efficient introspection of interfaces to retrieve the interface semantics and adapt the interaction with eye gaze. We have developed a Web browser, GazeTheWeb, that introspects Web page interfaces and adapts both the browser interface and the interaction elements on Web pages for gaze input. In a summative lab study with 20 participants, GazeTheWeb allowed the participants to accomplish information search and browsing tasks significantly faster than an emulation approach. Additional feasibility tests of GazeTheWeb in lab and home environment showcase its effectiveness in accomplishing daily Web browsing activities and adapting large variety of modern Web pages to suffice the interaction for people with motor impairment.

中文翻译：

---

改善基于眼动追踪的交互的用户体验

近年来，眼动追踪系统有了很大的改进，成为一种可行且经济实惠的数字通信渠道，尤其是对于缺乏精细运动技能的人而言。由于准确性和模糊性问题，使用眼动追踪作为输入法具有挑战性，因此眼动交互的研究主要集中在更好的指向和打字方法上。然而，这些方法最终需要被同化以使用户能够控制应用程序界面。使用眼动追踪来控制应用程序界面的一种常见方法是模拟鼠标和键盘功能。我们认为，仿真方法会为用户带来不必要的交互和视觉开销，从而加剧基于凝视的计算机访问的整个体验。我们讨论了有关界面语义的知识如何帮助减少交互和视觉开销以改善用户体验。因此，我们提出了有效的界面自省来检索界面语义并适应与眼睛注视的交互。我们开发了一个 Web 浏览器 GazeTheWeb，它可以内省网页界面，并调整浏览器界面和网页上的交互元素以进行注视输入。在一项有 20 名参与者的总结性实验室研究中，GazeTheWeb 让参与者能够比模拟方法更快地完成信息搜索和浏览任务。