当前位置: X-MOL 学术Int. J. Hum. Comput. Stud. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Sonification of the self vs. sonification of the other: Differences in the sonification of performed vs. observed simple hand movements
International Journal of Human-Computer Studies ( IF 5.3 ) Pub Date : 2020-06-20 , DOI: 10.1016/j.ijhcs.2020.102500
Roberto Bresin , Maurizio Mancini , Ludvig Elblaus , Emma Frid

Existing works on interactive sonification of movements, i.e., the translation of human movement qualities from the physical to the auditory domain, usually adopt a predetermined approach: the way in which movement features modulate the characteristics of sound is fixed. In our work we want to go one step further and demonstrate that the user role can influence the tuning of the mapping between movement cues and sound parameters. Here, we aim to verify if and how the mapping changes when the user is either the performer or the observer of a series of body movements (tracing a square or an infinite shape with the hand in the air). We asked participants to tune movement sonification while they were directly performing the sonified movement vs. while watching another person performing the movement and listening to its sonification. Results show that the tuning of the sonification chosen by participants is influenced by three variables: role of the user (performer vs observer), movement quality (the amount of Smoothness and Directness in the movement), and physical parameters of the movements (velocity and acceleration). Performers focused more on the quality of their movement, while observers focused more on the sonic rendering, making it more expressive and more connected to low-level physical features.



中文翻译:

自我的声音与他人的声音:已执行声音与观察到的简单手部动作在声音上的差异

现有的关于运动的声音交互化的著作,即人类运动质量从物理领域到听觉领域的转换,通常采用一种预定的方法:运动特征调节声音特征的方式是固定的。在我们的工作中,我们想更进一步,证明用户角色可以影响运动提示和声音参数之间映射的调整。在这里,我们旨在验证当用户是一系列身体运动的执行者或观察者(用手在空中描画正方形或无限形状)时,映射是否以及如何改变。我们要求参与者在直接进行声音化的动作时调整运动的声音,而不是观看其他人在进行动作并聆听其声音时调整声音的声音。结果表明,参与者选择的声音的调音受三个变量的影响:用户的角色(表演者与观察者),运动质量(运动中的平滑度和指向性)以及运动的物理参数(速度和加速度)。表演者更多地关注运动的质量,而观察者更多地关注声音的渲染,使其更具表现力,并与低级的物理特征更加紧密地联系在一起。

更新日期:2020-06-20
down
wechat
bug