Collaborative Mixed Reality (MR) technologies enable remote people to work together by sharing communication cues intrinsic to face-to-face conversations, such as eye gaze and hand gestures. While the role of visual cues has been investigated in many collaborative MR systems, the use of spatial auditory cues remains underexplored. In this paper, we present an MR remote collaboration system that shares both spatial auditory and visual cues between collaborators to help them complete a search task. Through two user studies in a large office, we found that compared to non-spatialized audio, the spatialized remote expert’s voice and auditory beacons enabled local workers to find small occluded objects with significantly stronger spatial perception. We also found that while the spatial auditory cues could indicate the spatial layout and a general direction to search for the target object, visual head frustum and hand gestures intuitively demonstrated the remote expert’s movements and the position of the target. Integrating visual cues (especially the head frustum) with the spatial auditory cues significantly improved the local worker’s task performance, social presence, and spatial perception of the environment.

协作混合现实（MR）技术使远程人员可以通过共享面对面对话所固有的通信提示（例如眼神和手势）来共同工作。尽管在许多协作MR系统中已经研究了视觉提示的作用，但对空间听觉提示的使用仍未得到充分的研究。在本文中，我们提出了一个MR远程协作系统，该系统在协作者之间共享空间听觉和视觉提示，以帮助他们完成搜索任务。通过在一个大型办公室中进行的两项用户研究，我们发现与非空间音频相比，空间远程专家的语音和听觉信标使本地工人能够找到具有明显更强空间感知能力的小物体。我们还发现，尽管空间听觉提示可以指示空间布局和搜索目标对象的大致方向，但可视的视锥头和手势直观地显示了远程专家的动作和目标的位置。将视觉提示（尤其是头部平截头体）与空间听觉提示结合在一起，可以显着改善本地工人的工作表现，社交氛围以及对环境的空间感知。