Abstract Gesture-based interaction has greatly changed the way in which we interact with online products by allowing users to control digital systems with hand movements. This study investigates how gesture-based interaction modes, namely, mid-air gesture and touchscreen gesture, compared with mouse-based interaction, affect consumers’ virtual product experiences (VPE) by eliciting mental imagery (i.e., haptic imagery and spatial imagery). Furthermore, we explore how visual product presentation can be designed to facilitate different types of interaction modes. Through a lab experiment, we find that touchscreen gesture outper- forms mid-air gesture and mouse-based interaction in terms of eliciting haptic imagery, and this effect is mitigated when 3D presentation is used. We also find that mid-air gesture outperforms touchscreen gesture and mouse-based interaction in terms of eliciting spatial imagery when 3D presentation is used. Both haptic imagery and spatial imagery can further reduce consumers’ product uncertainty. Our results extend prior work on interactivity design of VPE and further contribute to the emerging literature on gesture-based interaction.

中文翻译：

---

虚拟触摸产品：通过手势控制和视觉呈现促进消费者的心理意象

摘要 基于手势的交互允许用户通过手部动作控制数字系统，极大地改变了我们与在线产品交互的方式。本研究调查了基于手势的交互模式，即空中手势和触摸屏手势，与基于鼠标的交互相比，如何通过引发心理图像（即触觉图像和空间图像）来影响消费者的虚拟产品体验 (VPE)。此外，我们探索如何设计视觉产品展示以促进不同类型的交互模式。通过实验室实验，我们发现触摸屏手势在引发触觉图像方面优于空中手势和基于鼠标的交互，并且在使用 3D 演示时这种影响会得到缓解。我们还发现，在使用 3D 演示时，空中手势在引发空间图像方面优于触摸屏手势和基于鼠标的交互。触觉图像和空间图像都可以进一步降低消费者对产品的不确定性。我们的结果扩展了先前在 VPE 交互设计方面的工作，并进一步为基于手势的交互的新兴文献做出了贡献。