Occlusion is a powerful visual cue that is crucial for depth perception and realism in optical see-through augmented reality (OST-AR). However, existing OST-AR systems additively overlay physical and digital content with beam combiners - an approach that does not easily support mutual occlusion, resulting in virtual objects that appear semi-transparent and unrealistic. In this work, we propose a new type of occlusion-capable OST-AR system. Rather than additively combining the real and virtual worlds, we employ a single digital micromirror device (DMD) to merge the respective light paths in a multiplicative manner. This unique approach allows us to simultaneously block light incident from the physical scene on a pixel-by-pixel basis while also modulating the light emitted by a light-emitting diode (LED) to display digital content. Our technique builds on mixed binary/continuous factorization algorithms to optimize time-multiplexed binary DMD patterns and their corresponding LED colors to approximate a target augmented reality (AR) scene. In simulations and with a prototype benchtop display, we demonstrate hard-edge occlusions, plausible shadows, and also gaze-contingent optimization of this novel display mode, which only requires a single spatial light modulator.

中文翻译：

---

因子遮挡：支持单空间光调制器遮挡的光学透视增强现实显示。

遮挡是一种强大的视觉提示，对于光学透视增强现实（OST-AR）中的深度感知和真实感至关重要。但是，现有的OST-AR系统会通过光束组合器叠加叠加物理和数字内容-这种方法不容易支持相互遮挡，从而导致虚拟对象显得半透明且不现实。在这项工作中，我们提出了一种新型的具有遮挡功能的OST-AR系统。我们不是将现实世界和虚拟世界相加，而是采用单个数字微镜设备（DMD）以乘法方式合并各个光路。这种独特的方法使我们可以逐像素地同时阻挡从物理场景入射的光，同时还可以调制由发光二极管（LED）发出的光以显示数字内容。我们的技术建立在混合二进制/连续分解算法的基础上，以优化时分复用的二进制DMD模式及其对应的LED颜色，以近似目标增强现实（AR）场景。在仿真和原型台式显示器中，我们展示了硬边遮挡，合理的阴影以及这种新颖的显示模式（仅需一个空间光调制器）的视线优化。