Voice user interfaces (VUI) have been increasingly used in everyday settings and they are growing in popularity. These interfaces have predominantly eyes-free and hands-free interactions. This kind of experiences continues to be an inceptive field compared to other input methods such as touch or using the keyboard/mouse. Thus, it is important to identify tools used to evaluate the usability of VUIs. This article presents a systematic review, in which we analyzed 57 articles and describes nine questionnaires used for evaluating the usability of VUIs, assessing the potential suitability of these questionnaires to measure different types of interactions and various usability dimensions. We found that these questionnaires were used to evaluate the usability of voice-only and voice-added VUIs: AttrakDiff, ICF-US, MOS-X, SUISQ-R, SUS, SASSI, UEQ, PARADISE and USE, where the SUS questionnaire is the most commonly used. However, its items do not directly assess voice quality, although it evaluates the general user interaction with a system. All the questionnaires include items related to three usability dimensions (effectiveness, efficiency, and satisfaction). The questionnaire with the most homogeneous coverage regarding the number of items in each aspect of usability is the SASSI questionnaire. It is a normal practice to use multiple questionnaires to obtain a more complete measurement of usability. We perceive the necessity to increase usability research about the differences between the voice interaction with diverse display types (voice-first, voice-only, voice-added) and the dialog types (command-based and conversational), and how usability affects the user expectations about the VUIs.

中文翻译：

---

评估语音用户界面的可用性问卷

语音用户界面 (VUI) 越来越多地用于日常环境中，并且越来越受欢迎。这些界面主要具有免眼和免提交互。与其他输入方法（例如触摸或使用键盘/鼠标）相比，这种体验仍然是一个初级领域。因此，确定用于评估 VUI 可用性的工具非常重要。本文进行了系统回顾，其中我们分析了 57 篇文章并描述了 9 份用于评估 VUI 可用性的问卷，评估这些问卷在衡量不同类型的交互和各种可用性维度方面的潜在适用性。我们发现这些问卷用于评估纯语音和添加语音的 VUI 的可用性：AttrakDiff、ICF-US、MOS-X、SUISQ-R、SUS、SASSI、UEQ、PARADISE and USE，其中SUS问卷是最常用的。然而，它的项目不直接评估语音质量，尽管它评估一般用户与系统的交互。所有问卷都包括与三个可用性维度（有效性、效率和满意度）相关的项目。SASSI 问卷是关于可用性各个方面的项目数量的最均匀覆盖范围的问卷。通常的做法是使用多个问卷来获得更完整的可用性测量。我们认为有必要增加关于不同显示类型（语音优先、纯语音、添加语音）和对话类型（基于命令和对话）的语音交互之间的差异的可用性研究，以及可用性如何影响用户对 VUI 的期望。