Abstract Construction equipment teleoperation is a promising solution when the site environment is hazardous to operators. However, limited situational awareness of the operator, especially under adverse visual conditions, impedes the implementation of construction equipment teleoperation. Virtual annotations (VAs) have great potential to improve an operator's situational awareness. The work presented in this paper investigates the effects of VA by comparing the teleoperation performances of an excavator between an experimental group (with VA) and a control group (without VA) in a virtual environment. Subjects in the experimental group made significantly fewer collisions under the adverse visual condition than the subjects in the control group with similar 3D gaming experience. It indicates that properly-designed VAs can help operators efficiently integrate and understand information from different visual sources. Some negative effects were also observed, such as increased time of completion and a trend of increased collision numbers on the back of the equipment. Speculation is that an operator will form a visual base and selectively integrate information from other visual sources when the cognitive load exceeds a limit. The results suggested a need to investigate further the mechanism of forming a visual base and the assessment of an operator's cognitive load.

中文翻译：

---

不利视觉条件下虚拟标注对施工设备遥操作性能的影响

摘要 当现场环境对操作人员造成危害时，施工设备遥操作是一种很有前景的解决方案。然而，操作员有限的情境意识，尤其是在不利的视觉条件下，阻碍了施工设备遥操作的实施。虚拟注释 (VA) 具有提高操作员态势感知的巨大潜力。本文介绍的工作通过在虚拟环境中比较实验组（有 VA）和对照组（没有 VA）挖掘机的遥控性能来研究 VA 的影响。实验组受试者在不利视觉条件下的碰撞次数明显少于具有相似3D游戏体验的对照组受试者。这表明设计合理的 VA 可以帮助操作员有效地整合和理解来自不同视觉来源的信息。还观察到了一些负面影响，例如完成时间增加和设备背面碰撞次数增加的趋势。推测当认知负荷超过极限时，操作者会形成视觉基础并选择性地整合来自其他视觉来源的信息。结果表明需要进一步研究形成视觉基础的机制和操作员认知负荷的评估。推测当认知负荷超过极限时，操作者会形成视觉基础并选择性地整合来自其他视觉来源的信息。结果表明需要进一步研究形成视觉基础的机制和操作员认知负荷的评估。推测当认知负荷超过极限时，操作者会形成视觉基础并选择性地整合来自其他视觉来源的信息。结果表明需要进一步研究形成视觉基础的机制和操作员认知负荷的评估。