当前位置: X-MOL 学术J. Multimodal User Interfaces › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Movement sonification expectancy model: leveraging musical expectancy theory to create movement-altering sonifications
Journal on Multimodal User Interfaces ( IF 2.2 ) Pub Date : 2020-03-30 , DOI: 10.1007/s12193-020-00322-2
Joseph Newbold , Nicolas E. Gold , Nadia Bianchi-Berthouze

When designing movement sonifications, their effect on people’s movement must be considered. Recent work has shown how real-time sonification can be designed to alter the way people move. However, the mechanisms through which these sonifications alter people’s expectations of their movement is not well explained. This is especially important when considering musical sonifications, to which people bring their own associations and musical expectation, and which can, in turn, alter their perception of the sonification. This paper presents a Movement Expectation Sonification Model, based on theories of motor-feedback and expectation, to explore how musical sonification can impact the way people perceive their movement. Secondly, we present a study that validates the predictions of this model by exploring how harmonic stability within sonification interacts with contextual cues in the environment to impact movement behaviour and perceptions. We show how musical expectancy can be built to either reward or encourage movement, and how such an effect is mediated through the presence of additional cues. This model offers a way for sonification designers to create movement sonifications that not only inform movement but can be used to encourage progress and reward successes.

中文翻译:

运动声化期望模型:利用音乐期望理论创建改变运动的声化

在设计运动超声时,必须考虑它们对人们运动的影响。最近的工作表明,如何设计实时声波处理来改变人们的移动方式。然而,这些声音化改变人们对运动的期望的机制还没有得到很好的解释。这一点在考虑音乐声化时尤其重要,人们会带给他们自己的联想和音乐期望,进而可以改变他们对声化的理解。本文基于运动反馈和期望的理论,提出了一个运动期望声化模型,以探讨音乐声化如何影响人们感知运动的方式。其次,我们提出了一项研究,该研究通过探索声波内的谐波稳定性如何与环境中的上下文提示相互作用以影响运动行为和感知来验证该模型的预测。我们展示了如何建立音乐期望值来奖励或鼓励运动,以及如何通过其他提示的存在来调节这种效果。该模型为超音波设计人员提供了一种创建动作超音波的方法,不仅可以告知动作,还可以用来鼓励进步并奖励成功。
更新日期:2020-03-30
down
wechat
bug