The effective 3D manipulation, comprehension, and control of 3D objects on computers are well-established lasting problems, which include a display aspect, a control aspect, and a spatial coupling between control input and visual output aspect, which is a debatable issue. Most existing control interfaces are located in front of the display. This requires users to imagine that manipulated objects that are actually behind the display exist in front of the display. In this research, a Rear-Screen and Kinesthetic Vision 3D Manipulator is proposed for manipulating models on laptops. In contrast to the front-screen setup of a motion controller, it tracks a user’s hand motion behind screens, coupling the actual interactive space with the perceived visual space. In addition, Kinesthetic Vision provides a dynamic perspective of objects according to a user’s sight, by tracking the position of their head, in order to obtain depth perception using the “motion parallax” effect. To evaluate the performance of “rear-screen interaction” and Kinesthetic Vision, an experiment was conducted to compare the front-screen setup, the rear-screen setup with Kinesthetic Vision, and the rear-screen setup without it. Subjects were asked to grasp and move a cube from a fixed starting location to a target location in each trial. There were 20 designated target locations scattered in the interactive space. The moving time and distance were recorded during experiments. In each setup, subjects were asked to go through five trial blocks, including 20 trials in each block. The results show that there are significant differences in the moving efficiency by repeated measures ANOVA. The Rear-Screen and Kinesthetic Vision setup gives rise to better performance, especially in the depth direction of movements, where path length is reduced by 24%.

中文翻译：

---

后屏幕和动觉视觉3D机械手

在计算机上对3D对象进行有效的3D操作，理解和控制是公认的持久性问题，包括显示方面，控制方面以及控件输入和视觉输出方面之间的空间耦合，这是值得商bat的问题。现有的大多数控制界面都位于显示器的前面。这要求用户想象实际上在显示器后面的被操纵对象在显示器的前面。在这项研究中，提出了一种后屏幕和动觉视觉3D机械手，用于在笔记本电脑上操纵模型。与运动控制器的前屏幕设置相比，它在屏幕后面跟踪用户的手部运动，从而将实际的交互空间与感知的视觉空间耦合在一起。此外，Kinesthetic Vision通过跟踪对象的头部位置，根据用户的视线提供对象的动态透视图，以便使用“运动视差”效果获得深度感知。为了评估“后屏幕交互”和Kinesthetic Vision的性能，进行了一项实验，以比较前屏幕设置，具有Kinesthetic Vision的后屏幕设置和不具有Kinesthetic Vision的后屏幕设置。在每次试验中，要求受试者抓住立方体并将其从固定的起始位置移动到目标位置。有20个指定目标位置分散在互动空间中。实验期间记录了移动时间和距离。在每个设置中，要求受试者经历五个试验阶段，每个阶段包括20个试验。结果表明，通过重复测量方差分析，移动效率存在显着差异。后屏幕和动觉视觉设置可提供更好的性能，尤其是在运动的深度方向，路径长度减少了24％。