当前位置: X-MOL 学术arXiv.cs.HC › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Combining Gesture and Voice Control for Mid-Air Manipulation of CAD Models in VR Environments
arXiv - CS - Human-Computer Interaction Pub Date : 2020-11-18 , DOI: arxiv-2011.09138
Markus Friedrich, Stefan Langer, Fabian Frey

Modeling 3D objects in domains like Computer Aided Design (CAD) is time-consuming and comes with a steep learning curve needed to master the design process as well as tool complexities. In order to simplify the modeling process, we designed and implemented a prototypical system that leverages the strengths of Virtual Reality (VR) hand gesture recognition in combination with the expressiveness of a voice-based interface for the task of 3D modeling. Furthermore, we use the Constructive Solid Geometry (CSG) tree representation for 3D models within the VR environment to let the user manipulate objects from the ground up, giving an intuitive understanding of how the underlying basic shapes connect. The system uses standard mid-air 3D object manipulation techniques and adds a set of voice commands to help mitigate the deficiencies of current hand gesture recognition techniques. A user study was conducted to evaluate the proposed prototype. The combination of our hybrid input paradigm shows to be a promising step towards easier to use CAD modeling.

中文翻译:

结合手势和语音控制在 VR 环境中对 CAD 模型进行空中操作

在计算机辅助设计 (CAD) 等领域中对 3D 对象进行建模非常耗时,并且需要一个陡峭的学习曲线来掌握设计过程以及工具的复杂性。为了简化建模过程,我们设计并实现了一个原型系统,该系统利用虚拟现实 (VR) 手势识别的优势,并结合基于语音的界面的表现力来完成 3D 建模任务。此外,我们在 VR 环境中为 3D 模型使用构造实体几何 (CSG) 树表示,让用户从头开始操纵对象,直观地了解底层基本形状的连接方式。该系统使用标准的空中 3D 对象操作技术,并添加了一组语音命令,以帮助减轻当前手势识别技术的不足。进行了用户研究以评估提议的原型。我们的混合输入范式的组合表明是朝着更易于使用 CAD 建模迈出的有希望的一步。
更新日期:2020-11-19
down
wechat
bug