OBJECTIVE To report on the use of an eye-tracking retrospective think-aloud for usability evaluation and to describe its application in assessing the usability of a mobile health app. MATERIALS AND METHODS We used an eye-tracking retrospective think-aloud to evaluate the usability of an HIV prevention mobile app among 20 young men (15-18 years) in New York City, NY; Birmingham, AL; and Chicago, IL. Task performance metrics, critical errors, a task completion rate per participant, and a task completion rate per task, were measured. Eye-tracking metrics including fixation, saccades, time to first fixation, time spent, and revisits were measured and compared among participants with/without a critical error. RESULTS Using task performance analysis, we identified 19 critical errors on four activities, and of those, two activities had a task completion rate of less than 78%. To better understand these usability issues, we thoroughly analyzed participants' corresponding eye movements and verbal comments using an in-depth problem analysis. In areas of interest created for the activity with critical usability problems, there were significant differences in time spent (p = 0.008), revisits (p = 0.004), and total numbers of fixations (p = 0.007) by participants with/without a critical error. The overall mean score of perceived usability rated by the Health IT Usability Evaluation Scale was 4.64 (SD = 0.33), reflecting strong usability of the app. DISCUSSION AND CONCLUSION An eye-tracking retrospective think-aloud enabled us to identify critical usability problems as well as gain an in-depth understanding of the usability issues related to interactions between end-users and the app. Findings from this study highlight the utility of an eye-tracking retrospective think-aloud in consumer health usability evaluation research.

中文翻译：

---

眼动追踪追溯思维能力是一种用于可用性评估的新颖方法。

目的报告使用眼动追踪回顾性思维方式进行可用性评估，并描述其在评估移动健康应用程序可用性方面的应用。材料和方法我们使用眼动追踪回顾性思维方法，评估了纽约州纽约市20名年轻人（15-18岁）中艾滋病毒预防移动应用程序的可用性。阿拉巴马州伯明翰；和伊利诺伊州芝加哥。测量任务绩效指标，严重错误，每个参与者的任务完成率和每个任务的任务完成率。眼动追踪指标包括注视，眼球扫视，首次注视时间，花费的时间和再次访视，并在有/无严重错误的参与者之间进行了测量和比较。结果使用任务绩效分析，我们确定了四个活动中的19个严重错误，其中 两项活动的任务完成率不到78％。为了更好地理解这些可用性问题，我们使用深入的问题分析彻底分析了参与者的相应眼动和口头评论。在针对存在严重可用性问题的活动创建的感兴趣区域中，有/无严重参与者花费的时间（p = 0.008），重访（p = 0.004）和注视总数（p = 0.007）存在显着差异。错误。Health IT可用性评估量表对感知可用性的总体平均得分为4.64（SD = 0.33），反映了该应用程序的强大可用性。讨论与结论眼动追踪的回顾性思想使我们能够识别关键的可用性问题，并获得对与最终用户与应用程序之间的交互相关的可用性问题的深入了解。这项研究的结果强调了眼动追踪回顾性思维方法在消费者健康可用性评估研究中的作用。