当前位置: X-MOL 学术J. Multimodal User Interfaces › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Mapping for meaning: the embodied sonification listening model and its implications for the mapping problem in sonic information design
Journal on Multimodal User Interfaces ( IF 2.2 ) Pub Date : 2020-02-03 , DOI: 10.1007/s12193-020-00318-y
Stephen Roddy , Brian Bridges

This is a theoretical paper that considers the mapping problem, a foundational issue which arises when designing a sonification, as it applies to sonic information design. We argue that this problem can be addressed by using models from the field of embodied cognitive science, including embodied image schema theory, conceptual metaphor theory and conceptual blends, and from research which treats sound and musical structures using these models, when mapping data to sound. However, there are currently very few theoretical frameworks for applying embodied cognition principles in a sonic information design context. This article describes one such framework, the embodied sonification listening model, which provides a theoretical description of sonification listening in terms of conceptual metaphor theory.

中文翻译:

含义映射:声音化的听觉化模型及其对声音信息设计中映射问题的启示

这是一篇理论论文,考虑了映射问题,这是设计声波处理时出现的基础性问题,因为它适用于声音信息设计。我们认为,可以通过使用来自体现的认知科学领域的模型(包括体现的图像图式理论,概念隐喻理论和概念混合)以及通过将数据映射到声音时使用这些模型处理声音和音乐结构的研究来解决此问题。 。但是,目前很少有理论框架可在声音信息设计环境中应用体现的认知原理。本文介绍了一个这样的框架,即具体化的语音监听模型,该模型根据概念隐喻理论提供了语音监听的理论描述。
更新日期:2020-02-03
down
wechat
bug