当前位置: X-MOL 学术J. Multimodal User Interfaces › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Exploring interaction techniques for 360 panoramas inside a 3D reconstructed scene for mixed reality remote collaboration
Journal on Multimodal User Interfaces ( IF 2.2 ) Pub Date : 2020-07-25 , DOI: 10.1007/s12193-020-00343-x
Theophilus Teo , Mitchell Norman , Gun A. Lee , Mark Billinghurst , Matt Adcock

Remote collaboration using mixed reality (MR) enables two separated workers to collaborate by sharing visual cues. A local worker can share his/her environment to the remote worker for a better contextual understanding. However, prior techniques were using either 360 video sharing or a complicated 3D reconstruction configuration. This limits the interactivity and practicality of the system. In this paper we show an interactive and easy-to-configure MR remote collaboration technique enabling a local worker to easily share his/her environment by integrating 360 panorama images into a low-cost 3D reconstructed scene as photo-bubbles and projective textures. This enables the remote worker to visit past scenes on either an immersive 360 panoramic scenery, or an interactive 3D environment. We developed a prototype and conducted a user study comparing the two modes of how 360 panorama images could be used in a remote collaboration system. Results suggested that both photo-bubbles and projective textures can provide high social presence, co-presence and low cognitive load for solving tasks while each have its advantage and limitations. For example, photo-bubbles are good for a quick navigation inside the 3D environment without depth perception while projective textures are good for spatial understanding but require physical efforts.



中文翻译:

探索3D重建场景中用于混合现实远程协作的360个全景图的交互技术

使用混合现实(MR)进行的远程协作使两个独立的工作人员可以通过共享视觉提示进行协作。本地工作人员可以与远程工作人员共享他/她的环境,以更好地了解上下文。但是,现有技术使用的是360视频共享或复杂的3D重建配置。这限制了系统的交互性和实用性。在本文中,我们展示了一种交互式且易于配置的MR远程协作技术,通过将360张全景图像集成到低成本3D重建场景中(如照片气泡和投影纹理),本地工人可以轻松共享他/她的环境。这使远程工作者可以在沉浸式360度全景风景或交互式3D环境中访问过去的场景。我们开发了一个原型并进行了用户研究,比较了在远程协作系统中如何使用360度全景图像的两种模式。结果表明,照片泡沫和投射纹理都可以为解决任务提供较高的社交感,共存感和较低的认知负荷,而每种都有其优势和局限性。例如,照片气泡适合在3D环境中快速导航而无需深度感知,而投影纹理适合于空间理解,但需要体力劳动。

更新日期:2020-07-25
down
wechat
bug