当前位置: X-MOL 学术J. Multimodal User Interfaces › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Exploring crossmodal perceptual enhancement and integration in a sequence-reproducing task with cognitive priming
Journal on Multimodal User Interfaces ( IF 2.9 ) Pub Date : 2020-07-13 , DOI: 10.1007/s12193-020-00326-y
Feng Feng , Puhong Li , Tony Stockman

Crossmodal correspondence, a perceptual phenomenon which has been extensively studied in cognitive science, has been shown to play a critical role in people’s information processing performance. However, the evidence has been collected mostly based on strictly-controlled stimuli and displayed in a noise-free environment. In real-world interaction scenarios, background noise may blur crossmodal effects that designers intend to leverage. More seriously, it may induce additional crossmodal effects, which can be mutually exclusive to the intended one, leading to unexpected distractions from the task at hand. In this paper, we report two experiments designed to tackle these problems with cognitive priming techniques. The first experiment examined how to enhance the perception of specific crossmodal stimuli, namely pitch–brightness and pitch–elevation stimuli. The second experiment investigated how people perceive and respond to crossmodal stimuli that were mutually exclusive. Results showed that first, people’s crossmodal perception was affected by cognitive priming, though the effect varies according to the combination of crossmodal stimuli and the types of priming material. Second, when two crossmodal stimuli are mutually exclusive, priming on only the dominant one (Pitch–elevation) lead to improved performance. These results can help inform future design of multisensory systems by presenting details of how to enhance crossmodal information with cognitive priming.



中文翻译:

探索具有认知启动的序列重现任务中的交叉模态知觉增强和整合

交叉模式对应是一种在认知科学中已被广泛研究的感知现象,已被证明在人们的信息处理性能中起着至关重要的作用。但是,证据主要是根据严格控制的刺激收集的,并在无噪声的环境中显示。在现实世界的交互场景中,背景噪声可能会模糊设计人员打算利用的交叉峰效应。更严重的是,它可能会引起额外的交叉峰效应,而这种交叉峰效应可能与预期的互斥效应互斥,从而导致无法预期的注意力分散到当前的任务上。在本文中,我们报告了两个旨在通过认知启动技术解决这些问题的实验。第一个实验研究了如何增强对特定的交叉峰刺激的感知,即音高-亮度和音高-高度刺激。第二个实验研究了人们如何感知和响应相互排斥的交叉峰刺激。结果表明,首先,人们的交叉模态知觉受认知启动的影响,尽管其影响因交叉模态刺激和启动材料的类型而异。其次,当两个交叉模态刺激相互排斥时,仅对主要的刺激(音高)进行激发可改善性能。这些结果可以通过呈现有关如何借助认知启动来增强交叉模式信息的细节,来帮助指导多传感器系统的未来设计。人们的交叉模态知觉受认知启动的影响,尽管效果会因交叉模态刺激和启动材料的类型而异。其次,当两个交叉模态刺激相互排斥时,仅对主要的刺激(音高)进行激发可改善性能。这些结果可以通过呈现有关如何借助认知启动来增强交叉模式信息的细节,来帮助指导多传感器系统的未来设计。人们的交叉模态知觉受认知启动的影响,尽管效果会因交叉模态刺激和启动材料的类型而异。其次,当两个交叉模态刺激相互排斥时,仅对主要的刺激(音高)进行激发可改善性能。这些结果可以通过呈现有关如何借助认知启动来增强交叉模式信息的细节,来帮助指导多传感器系统的未来设计。

更新日期:2020-07-13
down
wechat
bug