Virtual Reality (VR) has the potential to transform knowledge work. One advantage of VR knowledge work is that it allows extending 2D displays into the third dimension, enabling new operations, such as selecting overlapping objects or displaying additional layers of information. On the other hand, mobile knowledge workers often work on established mobile devices, such as tablets, limiting interaction with those devices to a small input space. This challenge of a constrained input space is intensified in situations when VR knowledge work is situated in cramped environments, such as airplanes and touchdown spaces.

In this paper, we investigate the feasibility of interacting jointly between an immersive VR head-mounted display and a tablet within the context of knowledge work. Specifically, we 1) design, implement and study how to interact with information that reaches beyond a single physical touchscreen in VR; 2) design and evaluate a set of interaction concepts; and 3) build example applications and gather user feedback on those applications.

中文翻译：

---

打破屏幕：移动知识工作者在虚拟现实中跨越触摸屏边界的交互


虚拟现实 (VR) 具有改变知识工作的潜力。 VR 知识工作的优点之一是它允许将 2D 显示扩展到三维，从而实现新的操作，例如选择重叠对象或显示附加信息层。另一方面，移动知识工作者通常在平板电脑等现有移动设备上工作，将与这些设备的交互限制在很小的输入空间内。当 VR 知识工作位于狭窄的环境（例如飞机和着陆空间）时，输入空间受限的挑战会加剧。

在本文中，我们研究了在知识工作背景下沉浸式 VR 头戴式显示器和平板电脑之间联合交互的可行性。具体来说，我们 1) 设计、实现和研究如何与 VR 中超越单个物理触摸屏的信息进行交互； 2）设计并评估一套交互概念； 3) 构建示例应用程序并收集用户对这些应用程序的反馈。