当前位置: X-MOL 学术J. Multimodal User Interfaces › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Personalised interactive sonification of musical performance data
Journal on Multimodal User Interfaces ( IF 2.9 ) Pub Date : 2019-03-13 , DOI: 10.1007/s12193-019-00294-y
KatieAnna E. Wolf , Rebecca Fiebrink

In this article, we describe methods and consequences for giving audience members interactive control over the real-time sonification of performer movement data in electronic music performance. We first briefly describe how to technically implement a musical performance in which each audience member can interactively construct and change their own individual sonification of performers’ movements, heard through headphones on a personal WiFi-enabled device, while also maintaining delay-free synchronization between performer movements and sound. Then, we describe two studies we conducted in the context of live musical performances with this technology. These studies have allowed us to examine how providing audience members with the ability to interactively sonify performer actions impacted their experiences, including their perceptions of their own role and engagement with the performance. These studies also allowed us to explore how audience members with different levels of expertise with sonification and sound, and different motivations for interacting, could be supported and influenced by different sonification interfaces. This work contributes to a better understanding of how providing interactive control over sonification may alter listeners’ experiences, of how to support everyday people in designing and using bespoke sonifications, and of new possibilities for musical performance and participation.

中文翻译:

个性化的音乐演奏数据交互

在本文中,我们描述了使听众交互式控制电子音乐表演中表演者动作数据的实时超声处理的方法和结果。我们首先简要介绍如何从技术上实现音乐表演,在这种表演中,每个观众可以交互地构造和改变自己对表演者动作的声音,通过启用个人WiFi的设备上的耳机听到,同时还可以保持表演者之间的无延迟同步动作和声音。然后,我们描述了使用这项技术在现场音乐表演中进行的两项研究。这些研究使我们能够研究如何为受众群体成员提供以互动方式将表演者的行为超声化的能力如何影响他们的体验,包括他们对自己的角色和对表演的参与的看法。这些研究还使我们能够探索如何通过不同的声音交互界面来支持和影响具有不同专业水平的声音和声音以及不同互动动机的听众。这项工作有助于更好地了解如何通过交互控制音素来改变听众的体验,如何在设计和使用定制音素方面为日常工作提供支持,以及音乐表演和参与的新可能性。可以由不同的声音接口支持和影响。这项工作有助于更好地了解如何通过交互控制音素来改变听众的体验,如何在设计和使用定制音素方面为日常工作提供支持,以及音乐表演和参与的新可能性。可以由不同的声音界面支持和影响。这项工作有助于更好地了解如何通过交互控制音素来改变听众的体验,如何在设计和使用定制音素方面为日常工作提供支持,以及音乐表演和参与的新可能性。
更新日期:2019-03-13
down
wechat
bug