当前位置: X-MOL 学术J. Multimodal User Interfaces › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
The effect of eye movement sonification on visual search patterns and anticipation in novices
Journal on Multimodal User Interfaces ( IF 2.9 ) Pub Date : 2021-10-18 , DOI: 10.1007/s12193-021-00381-z
Maryam Khalaji 1, 2 , Mahin Aghdaei 2 , Alireza Farsi 2 , Alessandro Piras 3
Affiliation  

Visual information is essential to successfully anticipate the direction of the shot in ball sports whereas using another sense in motor learning has received less attention. The present study aimed to examine whether the multisensory learning with the orienting visual attention through the sound would influence anticipatory judgments with respect to the visual system alone. Forty novice students were randomly divided into visual and audio-visual groups. The experimental procedure comprised two phases; 1 training and 3 testing phases, respectively. During the training sessions, 200 video clips were employed to anticipate the direction of the shot, interspersed by 5-min of rest every 25 trials. A sound was used to orient the attention of the audio-visual group toward key points meanwhile the visual group watched the videos without sounds. Then, during the testing phases, they watched 20 video clips in the pretest, immediate retention, and delay retention test. The film was occluded at the racket-ball contact and then they quickly and carefully decided the direction of the shot. The audio-visual group showed higher response accuracy and shorter decision time than the visual group in the immediate and delayed retention. The audio-visual group exhibited longer fixation duration to the key areas than the visual group. In conclusion, using multisensory learning may not only reallocate perceptual and cognitive workload but also could reduce distraction, since, unlike visual perception, auditory perception requires neither specific athlete orientation nor a focus of attention. In general, the use of the multisensory learning is likely to be effective in learning complex motor tasks, facilitating the discovery of the new task needs and helping to perceive the exercise structure.



中文翻译:

眼动声化对新手视觉搜索模式和预期的影响

视觉信息对于成功预测球类运动中的击球方向至关重要,而在运动学习中使用另一种感觉却很少受到关注。本研究旨在检验通过声音定向视觉注意力的多感官学习是否会影响仅针对视觉系统的预期判断。四十名新手学生被随机分为视觉组和视听组。实验程序包括两个阶段;分别为 1 个训练阶段和 3 个测试阶段。在训练期间,使用了 200 个视频剪辑来预测射击的方向,每 25 次试验穿插 5 分钟的休息。使用声音将视听组的注意力引导到关键点,同时视觉组在没有声音的情况下观看视频。然后,在测试阶段,他们观看了预测试、立即保留和延迟保留测试中的 20 个视频片段。胶卷在球拍接触时被遮挡,然后他们迅速而仔细地决定了拍摄的方向。视听组在即时记忆和延迟记忆方面比视觉组表现出更高的反应准确率和更短的决策时间。视听组对关键区域的注视时间比视觉组长。总之,使用多感官学习不仅可以重新分配感知和认知工作量,还可以减少分心,因为与视觉感知不同,听觉感知既不需要特定的运动员方向,也不需要注意力集中。一般来说,多感官学习的使用可能对学习复杂的运动任务很有效,

更新日期:2021-10-18
down
wechat
bug