The use of mobile phones while driving has been a hot topic in the field of driving safety for decades. Although there are few studies on the influence of gesture control on in-vehicle secondary tasks, this study aims to investigate the impact of gesture-based mobile phone use without touching while driving from the perspective of multiple-resource workload owing to visual, auditory, cognitive, and psychomotor resource occupation. A novel gesture control technique was adopted for secondary task interactions, to recognize the gestures of drivers. An experiment was conducted to study the influences of two interaction modes, traditional touch-based mobile phone interaction and gesture-based mobile phone interaction, on driving behavior in three different cognitive level task groups. The results indicate that gesture-based mobile phone interaction can improve driving performance with regard to lateral position-keeping ability and steering wheel control; nevertheless, it has no significant impact on longitudinal metrics such as driving speed, driving speed variation, and throttle control variation. Gesture-based mobile phone interactions have a larger effect on secondary tasks with medium cognitive load but not on actual operation tasks. It was also verified that the performance of gesture-based mobile phone interaction was better in secondary mobile phone tasks such as switching (e.g., switching songs) and adjusting (e.g., adjusting volume) than the traditional interaction mode. This study provides the theoretical and experimental support for human–computer interaction using gesture-based mobile phone interactive control in future automobiles.

几十年来，开车时使用手机一直是行车安全领域的热门话题。虽然关于手势控制对车载辅助任务影响的研究较少，但本研究旨在从视觉、听觉、认知和心理运动资源占用。次要任务交互采用了一种新颖的手势控制技术，以识别驾驶员的手势。通过实验研究了传统的基于触摸的手机交互和基于手势的手机交互两种交互模式对三个不同认知水平任务组的驾驶行为的影响。结果表明，基于手势的手机交互可以提高横向保持能力和方向盘控制方面的驾驶性能；尽管如此，它对行驶速度、行驶速度变化和油门控制变化等纵向指标没有显着影响。基于手势的手机交互对中等认知负荷的次要任务影响较大，但对实际操作任务没有影响。还验证了基于手势的手机交互在切换（如切换歌曲）和调整（如调节音量）等次要手机任务中的性能优于传统交互模式。