当前位置: X-MOL 学术Comput. Assist. Surg. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
A non-contact interactive stereo display system for exploring human anatomy.
Computer Assisted Surgery ( IF 1.5 ) Pub Date : 2019-04-02 , DOI: 10.1080/24699322.2018.1560083
Ziteng Liu 1 , Wenpeng Gao 1 , Yu Sun 2 , Yixian Su 2 , Jiahua Zhu 2 , Lubing Xu 1 , Yili Fu 1, 2
Affiliation  

Stereoscopic display based on Virtual Reality (VR) can facilitate doctors to observe the 3 D virtual anatomical models with the depth cues, assist them in intuitively investigating the spatial relationship between different anatomical structures without mental imagination. However, there is few input device can be used in controlling the virtual anatomical models in the sterile operating room. This paper presents a cost-effective VR application system for demonstration of 3 D virtual anatomical models with non-contact interaction and stereo display. The system is integrated with hand gesture interaction and voice interaction to achieve non-contact interaction. Hand gesture interaction is implemented based on a Leap Motion controller mounted on the Oculus Rift DK2. Voice is converted into operation using Bing Speech for English language and Aitalk for Chinese language, respectively. A local relationship database is designed to record the anatomical terminologies to speech recognition engine to query these uncommon words. The hierarchical nature of these terminologies is also recorded in a tree structure. In the experiments, ten participants were asked to perform the evaluation on the proposed system. The results show that our system is more efficient than traditional interactive manner and verify the feasibility and practicability in the sterile operating room.

中文翻译:

一种用于探索人体解剖结构的非接触式交互式立体显示系统。

基于虚拟现实(VR)的立体显示可以帮助医生观察具有深度提示的3D虚拟解剖模型,帮助他们直观地研究不同解剖结构之间的空间关系,而无需费心。但是,很少有输入设备可用于控制无菌手术室中的虚拟解剖模型。本文提出了一种具有成本效益的VR应用系统,用于演示具有非接触式交互和立体显示的3D虚拟解剖模型。该系统与手势交互和语音交互集成在一起,以实现非接触式交互。手势交互是基于安装在Oculus Rift DK2上的Leap Motion控制器实现的。语音分别使用英语的Bing Speech和中文的Aitalk转换为操作。设计一个本地关系数据库来记录解剖学术语,以便语音识别引擎查询这些不常见的单词。这些术语的分层性质也记录在树形结构中。在实验中,要求十名参与者对建议的系统进行评估。结果表明,我们的系统比传统的交互方式效率更高,并且证明了在无菌手术室中的可行性和实用性。这些术语的分层性质也记录在树形结构中。在实验中,要求十名参与者对建议的系统进行评估。结果表明,我们的系统比传统的交互方式效率更高,并且证明了在无菌手术室中的可行性和实用性。这些术语的层次结构性质也记录在树形结构中。在实验中,要求十名参与者对建议的系统进行评估。结果表明,我们的系统比传统的交互方式效率更高,并且证明了在无菌手术室中的可行性和实用性。
更新日期:2019-11-01
down
wechat
bug