Using touchscreens while driving introduces competition for visual attention that increases crash risk. To resolve this issue, we have developed an auditory-supported air gesture system. We conducted two experiments using the driving simulator to investigate the influence of this system on driving performance, eye glance behavior, secondary task performance, and driver workload. In Experiment 1 we investigated the impact of menu layout and auditory displays with 23 participants. In Experiment 2 we compared the best systems from Experiment 1 with equivalent touchscreen systems with 24 participants. Results from Experiment 1 showed that menus arranged in 2 × 2 grids outperformed systems with 4 × 4 grids across all measures and also demonstrated that auditory displays can be used to reduce visual demands of in-vehicle controls. In Experiment 2 auditory-supported air gestures allowed drivers to look at the road more, showed equivalent driver workload and driving performance, and slightly decreased secondary task performance compared to touchscreens. Implications are discussed with multiple resources theory and Fitts’s law.

中文翻译：

---

车辆中听觉支持的空中手势控制的设计和评估

驾驶时使用触摸屏会引起视觉注意力的竞争，从而增加撞车风险。为解决此问题，我们开发了一种由听觉支持的空中手势系统。我们使用驾驶模拟器进行了两个实验，以研究该系统对驾驶性能，眼神行为，次要任务性能和驾驶员工作负荷的影响。在实验1中，我们调查了23位参与者的菜单布局和听觉显示的影响。在实验2中，我们将实验1中的最佳系统与具有24名参与者的等效触摸屏系统进行了比较。实验1的结果表明，以2×2网格排列的菜单在所有度量上均优于具有4×4网格的系统，并且还表明听觉显示可用于减少车​​载控件的视觉需求。在实验2中，与触摸屏相比，听觉支持的手势使驾驶员能够更多地注视道路，表现出同等的驾驶员工作量和驾驶性能，并且次要任务的性能略有下降。用多种资源理论和菲茨定律讨论了蕴涵。