User acceptance of virtual reality (VR) applications is dependent on multiple aspects, such as usability, enjoyment, and cybersickness. To fully realize the disruptive potential of VR technology in light of recent technological advancements (e.g., advanced headsets, immersive graphics), gaining a deeper understanding of underlying factors and dimensions impacting and contributing to the overall end-user experience is of great benefit to hardware manufacturers, software and content developers, and service providers. To provide insight into user behaviour and preferences, researchers conduct user studies exploring the influence of various user-, system-, and context-related factors on the overall Quality of Experience (QoE) and its dimensions. When planning and executing such studies, researchers are faced with numerous methodological challenges related to study design aspects, such as specification of dependant and independent variables, subjective and objective assessment methods, preparation of test materials, test environment, and participant recruitment. Approaching these challenges from a multidisciplinary perspective, this paper reviews different aspects of performing perception-based QoE assessment for interactive VR applications and presents options and recommendations for research methodology design. We provide an overview of different influence factors and dimensions that may affect the overall QoE, with a focus on presence, immersion, and discomfort. Furthermore, we address ethical and practical issues regarding participant choice and test material, present different assessment methods and measures commonly used in VR research, and discuss approaches to choosing study duration and location. Lastly, we provide a concise analysis of key challenges that need to be addressed in future studies centered around VR QoE.

用户对虚拟现实 (VR) 应用程序的接受度取决于多个方面，例如可用性、乐趣和晕机症状。鉴于最近的技术进步（例如，先进的耳机、沉浸式图形），为了充分发挥 VR 技术的颠覆性潜力，深入了解影响和贡献整体最终用户体验的潜在因素和维度对硬件来说非常有利制造商、软件和内容开发商以及服务提供商。为了深入了解用户行为和偏好，研究人员进行了用户研究，探索各种用户、系统和上下文相关因素对整体体验质量 (QoE) 及其维度的影响。在规划和执行此类研究时，研究人员面临着与研究设计方面相关的众多方法学挑战，例如因变量和自变量的规范、主观和客观评估方法、测试材料的准备、测试环境和参与者招募。本文从多学科的角度应对这些挑战，回顾了针对交互式 VR 应用程序执行基于感知的 QoE 评估的不同方面，并提出了研究方法设计的选项和建议。我们概述了可能影响整体 QoE 的不同影响因素和维度，重点关注存在感、沉浸感和不适感。此外，我们还解决了有关参与者选择和测试材料的伦理和实际问题，提出了 VR 研究中常用的不同评估方法和措施，并讨论了选择研究持续时间和地点的方法。最后，我们对未来以 VR QoE 为中心的研究中需要解决的关键挑战进行了简要分析。