当前位置: X-MOL 学术IEEE Comput. Graph. Appl. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Spatialised Audio in a Custom-Built OpenGL-based Ear Training Virtual Environment
IEEE Computer Graphics and Applications ( IF 1.8 ) Pub Date : 2020-09-01 , DOI: 10.1109/mcg.2020.3013439
Karsten Pedersen 1 , Vedad Hulusic 1 , Panos Amelidis 1 , Tim Slattery 1
Affiliation  

Interval recognition is an important part of ear training—the key aspect of music education. Once trained, the musician can identify pitches, melodies, chords, and rhythms by listening to music segments. In a conventional setting, the tutor would teach a trainee the intervals using a musical instrument, typically a piano. However, this is expensive, time consuming, and nonengaging for either party. With the emergence of new technologies, including virtual reality (VR) and areas such as edutainment, this and similar trainings can be transformed into more engaging, more accessible, customizable (virtual) environments, with the addition of new cues and bespoke progression settings. In this work, we designed and implemented a VR ear training system for interval recognition. The usability, user experience, and the effect of multimodal integration through the addition of a perceptual cue, spatial audio, was investigated in two experiments with 46 participants. The results show that the system is highly acceptable and provides a very good experience for users. Furthermore, we show that the added spatial auditory cues provided in the VR application give users significantly more information for judging the musical intervals, something that is not possible in a non-VR environment.

中文翻译:

自定义构建的基于 OpenGL 的耳朵训练虚拟环境中的空间化音频

音程识别是听力训练的重要组成部分——音乐教育的关键方面。经过训练后,音乐家可以通过听音乐片段来识别音高、旋律、和弦和节奏。在传统环境中,导师会使用乐器(通常是钢琴)向受训者教授音程。然而,这对任何一方来说都是昂贵、耗时且不参与的。随着新技术的出现,包括虚拟现实 (VR) 和寓教于乐等领域,这种培训和类似的培训可以转变为更具吸引力、更易于访问、可定制的(虚拟)环境,并添加新的线索和定制的进程设置。在这项工作中,我们设计并实现了一个用于间隔识别的 VR 耳朵训练系统。可用性,用户体验,并且在 46 名参与者的两个实验中研究了通过添加感知线索空间音频的多模态整合的影响。结果表明,该系统具有很高的接受度,并为用户提供了非常好的体验。此外,我们展示了 VR 应用程序中提供的附加空间听觉线索为用户提供了更多的信息来判断音程,这在非 VR 环境中是不可能的。
更新日期:2020-09-01
down
wechat
bug