We develop a stereo-multispectral endoscopic prototype in which a filter-wheel is used for surgical guidance to remove cholesteatoma tissue in the middle ear. Cholesteatoma is a destructive proliferating tissue. The only treatment for this disease is surgery. Removal is a very demanding task, even for experienced surgeons. It is very difficult to distinguish between bone and cholesteatoma. In addition, it can even reoccur if not all tissue particles of the cholesteatoma are removed, which leads to undesirable follow-up operations. Therefore, we propose an image-based method that combines multispectral tissue classification and 3D reconstruction to identify all parts of the removed tissue and determine their metric dimensions intraoperatively. The designed multispectral filter-wheel 3D-endoscope prototype can switch between narrow-band spectral and broad-band white illumination, which is technically evaluated in terms of optical system properties. Further, it is tested and evaluated on three patients. The wavelengths 400 nm and 420 nm are identified as most suitable for the differentiation task. The stereoscopic image acquisition allows accurate 3D surface reconstruction of the enhanced image information. The first results are promising, as the cholesteatoma can be easily highlighted, correctly identified, and visualized as a true-to-scale 3D model showing the patient-specific anatomy.

中文翻译：

---

使用多光谱 3D 内窥镜切除胆脂瘤的手术指南。


我们开发了一种立体多光谱内窥镜原型，其中滤光轮用于手术引导以去除中耳的胆脂瘤组织。胆脂瘤是一种破坏性增殖组织。这种疾病的唯一治疗方法是手术。即使对于经验丰富的外科医生来说，切除也是一项非常艰巨的任务。区分骨瘤和胆脂瘤非常困难。另外，如果胆脂瘤的组织颗粒没有全部清除，甚至可能会再次发生，导致后续手术不良。因此，我们提出了一种基于图像的方法，结合多光谱组织分类和 3D 重建来识别切除组织的所有部分并在术中确定其度量尺寸。设计的多光谱滤光轮3D内窥镜原型可以在窄带光谱和宽带白色照明之间切换，并根据光学系统特性进行技术评估。此外，它还在三名患者身上进行了测试和评估。 400 nm 和 420 nm 的波长被认为最适合区分任务。立体图像采集允许对增强的图像信息进行精确的 3D 表面重建。第一个结果是有希望的，因为胆脂瘤可以很容易地突出显示、正确识别，并可视化为真实比例的 3D 模型，显示患者特定的解剖结构。