Abstract When typing on smartphones or palm tablets, users generally make an effort to type correctly while simultaneously checking the small keyboard and the text display. Unlike physical keyboards that allow users to perform typing based on long-term muscle memory, virtual keyboards typically require more frequent eye movements between the keyboard and the text display areas. This study proposes a new way of designing a virtual keyboard display to reduce the effort associated with frequent eye-movements. For this study, we developed virtual keyboard display systems featuring both static and dynamic word-by-word (WBW) feedback displays. The two display systems were examined in comparison with a more conventional method known as character-by-character (CBC) feedback display. We investigated user satisfaction, typing performance and the user’s eye gaze shifts. Eye gaze shifts were measured between the keyboard and the text display areas across the three conditions using self-report, log, and eye-tracking measures. In the static WBW condition, the words being typed displayed in a fixed area at the top of the virtual keyboard; in the dynamic WBW display, the words displayed in a small popup window at the tip of the selected key. Using a repeated measure experiment for the three display conditions, participants were asked to type fifteen phrases using a palm tablet while wearing eye-tracking glasses for each condition. We conducted a mixed-model design ANOVA with group (SLOW vs. FAST typing; men vs. women) as between-subject factors and display condition (CBC vs. WBW). We found a significant (11%) improvement in typing speed with the dynamic WBW over the CBC display for less experienced keyboard users. In addition, participants reported higher satisfaction with the two WBW conditions than the CBC condition. Eye fixations, dwell times, and heat map data also supported that WBW displays are advantageous for less experienced, slower typists by helping them stay focused more on the keyboard, thus reducing eye transitions to the text display. Our study systematically demonstrates how and to what extent the virtual keyboard display strategy influences typing performance and subjective experience based on self-reports and eye-tracking measures. The approach and findings of this study should provide useful information and practical guidance to mobile application developers and designers who are interested in improving virtual keyboard functionalities and user satisfaction.

中文翻译：

---

探索虚拟键盘的触摸反馈显示以减少眼球运动

摘要 在智能手机或掌上平板电脑上打字时，用户通常会努力正确打字，同时检查小键盘和文本显示。与允许用户基于长期肌肉记忆进行打字的物理键盘不同，虚拟键盘通常需要在键盘和文本显示区域之间进行更频繁的眼球运动。这项研究提出了一种设计虚拟键盘显示器的新方法，以减少与频繁眼球运动相关的工作量。在这项研究中，我们开发了具有静态和动态逐字 (WBW) 反馈显示功能的虚拟键盘显示系统。将这两种显示系统与称为逐字符 (CBC) 反馈显示的更传统方法进行了比较。我们调查了用户满意度，打字性能和用户的视线转移。使用自我报告、日志和眼动追踪测量在三种情况下测量键盘和文本显示区域之间的视线转移。在静态WBW条件下，输入的文字显示在虚拟键盘顶部的固定区域；在动态 WBW 显示中，文字显示在所选键尖端的小弹出窗口中。使用针对三种显示条件的重复测量实验，参与者被要求使用掌上电脑输入 15 个短语，同时为每种条件戴上眼动追踪眼镜。我们进行了混合模型设计方差分析，将组（慢与快打字；男性与女性）作为受试者之间的因素和显示条件（CBC 与 WBW）。我们发现，对于经验不足的键盘用户，动态 WBW 比 CBC 显示器显着 (11%) 提高了打字速度。此外，参与者对两种 WBW 条件的满意度高于 CBC 条件。眼睛注视、停留时间和热图数据也支持 WBW 显示对经验不足、速度较慢的打字员有利，帮助他们将更多的注意力集中在键盘上，从而减少眼睛转移到文本显示。我们的研究系统地展示了基于自我报告和眼动追踪测量的虚拟键盘显示策略如何以及在多大程度上影响打字性能和主观体验。