当前位置: X-MOL 学术Comput. Assist. Surg. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
A non-contact interactive stereo display system for exploring human anatomy.
Computer Assisted Surgery ( IF 1.5 ) Pub Date : 2019-02-11 , DOI: 10.1080/24699322.2018.1557899
Ziteng Liu 1 , Wenpeng Gao 1 , Yu Sun 2 , Yixian Su 2 , Jiahua Zhu 2 , Lubing Xu 1 , Yili Fu 1, 2
Affiliation  

Stereoscopic display based on Virtual Reality (VR) can facilitate clinicians observing 3 D anatomical models with the depth cue which lets them understand the spatial relationship between different anatomical structures intuitively. However, there are few input devices available in the sterile field of the operating room for controlling 3 D anatomical models. This paper presents a cost-effective VR application for stereo display of 3 D anatomical models with non-contact interaction. The system is integrated with hand gesture interaction and voice interaction to achieve non-contact interaction. Hand gesture interaction is based on Leap Motion. Voice interaction is implemented based on Bing Speech for English language and Aitalk for Chinese language. A local database is designed to record the anatomical terminologies organized in a tree structure, and provided to the speech recognition engine for querying these uncommon words. Ten participants were asked to practice the proposed system and compare it with the common interactive manners. The results show that our system is more efficient than the common interactive manner and prove the feasibility and practicability of the proposed system used in the sterile field.



中文翻译:


用于探索人体解剖学的非接触式交互式立体显示系统。



基于虚拟现实(VR)的立体显示可以方便临床医生通过深度提示观察3D解剖模型,直观地了解不同解剖结构之间的空间关系。然而,在手术室的无菌区域中,用于控制3D解剖模型的输入设备很少。本文提出了一种经济高效的 VR 应用程序,用于通过非接触交互立体显示 3D 解剖模型。系统融合手势交互和语音交互,实现非接触式交互。手势交互基于Leap Motion。英语语音交互基于Bing Speech,中文基于Aitalk实现。本地数据库被设计用来记录以树形结构组织的解剖术语,并提供给语音识别引擎来查询这些不常见的单词。十名参与者被要求练习所提出的系统,并将其与常见的交互方式进行比较。结果表明,我们的系统比常见的交互方式更加高效,证明了所提出的系统在无菌领域使用的可行性和实用性。

更新日期:2019-02-11
down
wechat
bug