The haptic illusion literature suggests that individuals’ haptic experiences rely not only on tactile signals, but on visual and auditory stimulation as well. Given that mixed reality (MR) technologies often harness realistic visual and auditory but not haptic stimulation, it is important to understand how visual and auditory signals shape haptic experiences. We examined whether visual and auditory cues in MR can enhance tactile sensation, including perceptions of roughness and stiffness on virtual gadgets, in the absence of haptic signals. A laboratory experiment showed that tactile perception of mobile gadgets in motion was influenced by both visual and auditory cues when the motion of the gadget was generated by participants (i.e., active touch), but only by auditory cues when participants observed the gadget moving (i.e., passive touch). The results indicate that visual and auditory cues can be employed to facilitate haptic experiences of virtual objects in virtual reality, with auditory cues being potentially applicable to a broader context than visual cues.

触觉幻觉文献表明，个人的触觉体验不仅依赖于触觉信号，还依赖于视觉和听觉刺激。鉴于混合现实（MR）技术通常会利用逼真的视觉和听觉而非触觉刺激，因此了解视觉和听觉信号如何塑造触觉体验非常重要。我们检查了在没有触觉信号的情况下，MR中的视觉和听觉提示是否可以增强触觉，包括虚拟设备上的粗糙感和僵硬感。实验室实验表明，当参与者产生小工具的运动（即主动触摸）时，运动小工具的触觉受视觉和听觉提示的影响，而当参与者观察到小工具运动时（即主动触摸），听觉提示会影响听觉提示。 ，被动触摸）。