当前位置: X-MOL 学术J. Multimodal User Interfaces › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Combining audio and visual displays to highlight temporal and spatial seismic patterns
Journal on Multimodal User Interfaces ( IF 2.2 ) Pub Date : 2021-07-27 , DOI: 10.1007/s12193-021-00378-8
Arthur Paté 1 , Gaspard Farge 2 , Benjamin K. Holtzman 3 , Anna C. Barth 3 , Piero Poli 4 , Lapo Boschi 5, 6, 7 , Leif Karlstrom 8
Affiliation  

Data visualization, and to a lesser extent data sonification, are classic tools to the scientific community. However, these two approaches are very rarely combined, although they are highly complementary: our visual system is good at recognizing spatial patterns, whereas our auditory system is better tuned for temporal patterns. In this article, data representation methods are proposed that combine visualization, sonification, and spatial audio techniques, in order to optimize the user’s perception of spatial and temporal patterns in a single display, to increase the feeling of immersion, and to take advantage of multimodal integration mechanisms. Three seismic data sets are used to illustrate the methods, covering different physical phenomena, time scales, spatial distributions, and spatio-temporal dynamics. The methods are adapted to the specificities of each data set, and to the amount of information that the designer wants to display. This leads to further developments, namely the use of audification with two time scales, the switch from pure audification to time-modulated noise, and the switch from pure audification to sonic icons. First user feedback from live demonstrations indicates that the methods presented in this article seem to enhance the perception of spatio-temporal patterns, which is a key parameter to the understanding of seismically active systems, and a step towards apprehending the processes that drive this activity.



中文翻译:

结合音频和视觉显示以突出​​时间和空间地震模式

数据可视化,以及在较小程度上的数据声化,是科学界的经典工具。然而,这两种方法很少结合使用,尽管它们高度互补:我们的视觉系统擅长识别空间模式,而我们的听觉系统则更好地适应时间模式。本文提出了结合可视化、声音化和空间音频技术的数据表示方法,以优化用户在单一显示中对空间和时间模式的感知,增加沉浸感,并利用多模态整合机制。三个地震数据集用于说明这些方法,涵盖不同的物理现象、时间尺度、空间分布和时空动力学。这些方法适用于每个数据集的特性,以及设计者想要显示的信息量。这导致了进一步的发展,即使用两个时间尺度的听音,从纯听音到时间调制噪声的转换,以及从纯听音到声波图标的转换。来自现场演示的第一个用户反馈表明,本文中介绍的方法似乎增强了对时空模式的感知,这是理解地震活动系统的关键参数,也是理解驱动这种活动的过程的一步。从纯听觉切换到时间调制噪声,以及从纯听觉切换到声波图标。来自现场演示的第一个用户反馈表明,本文中介绍的方法似乎增强了对时空模式的感知,这是理解地震活动系统的关键参数,也是理解驱动这种活动的过程的一步。从纯听觉切换到时间调制噪声,以及从纯听觉切换到声波图标。来自现场演示的第一个用户反馈表明,本文中介绍的方法似乎增强了对时空模式的感知,这是理解地震活动系统的关键参数,也是理解驱动这种活动的过程的一步。

更新日期:2021-07-27
down
wechat
bug