Ultrasonic mid-air haptic technology allows for the perceptual rendering of textured surfaces onto the user's hand. Unlike real textured surfaces, however, mid-air haptic feedback lacks implicit multisensory cues needed to reliably infer a texture's attributes (e.g., its roughness). In this paper, we combined mid-air haptic textures with congruent sound feedback to investigate how sonification could influence people's (1) explicit judgment of the texture attributes, (2) explicit sensations of their own hand, and (3) implicit motor behavior during haptic exploration. Our results showed that audio cues (presented solely or combined with haptics) influenced participants' judgment of the texture attributes (roughness, hardness, moisture and viscosity), produced some hand sensations (the feeling of having a hand smoother, softer, looser, more flexible, colder, wetter and more natural), and changed participants' speed (moving faster or slower) while exploring the texture. We then conducted a principal component analysis to better understand and visualize the found results and conclude with a short discussion on how audio-haptic associations can be used to create embodied experiences in emerging application scenarios in the metaverse.

中文翻译：

---

听起来很酷：探索空中触觉纹理的声音化对纹理判断、身体感知和运动行为的探索。

超声波空中触觉技术可以将纹理表面感知渲染到用户的手上。然而，与真实的纹理表面不同，空中触觉反馈缺乏可靠地推断纹理属性（例如，其粗糙度）所需的隐式多感官线索。在本文中，我们将空中触觉纹理与一致的声音反馈相结合，以研究可听化如何影响人们的（1）对纹理属性的明确判断，（2）自己手的明确感觉，以及（3）在触觉探索。我们的结果表明，音频提示（单独呈现或与触觉结合）影响参与者对纹理属性（粗糙度、硬度、湿度和粘度）的判断，产生一些手部感觉（手部更光滑、更柔软、更宽松、更光滑的感觉）。灵活、更冷、更湿、更自然），并在探索纹理时改变参与者的速度（移动得更快或更慢）。然后，我们进行了主成分分析，以更好地理解和可视化发现的结果，并以关于如何使用音频触觉关联在元宇宙中的新兴应用场景中创建具体体验的简短讨论作为结束。