In augmented reality, it is important to achieve visual consistency between inserted virtual objects and the real scene. As specular and transparent objects can produce caustics, which affect the appearance of inserted virtual objects, we herein propose a framework for differential rendering beyond the Lambertian-world assumption. Our key idea is to jointly optimize illumination and parameters of specular and transparent objects. To estimate the parameters of transparent objects efficiently, the psychophysical scaling method is introduced while considering visual characteristics of the human eye to obtain the step size for estimating the refractive index. We verify our technique on multiple real scenes, and the experimental results show that the fusion effects are visually consistent.

中文翻译：

---

超越朗伯世界假设的差分渲染改进增强现实框架


在增强现实中，实现插入的虚拟对象和真实场景之间的视觉一致性非常重要。由于镜面和透明物体会产生焦散，从而影响插入的虚拟物体的外观，因此我们在此提出了一种超越朗伯世界假设的差分渲染框架。我们的关键思想是联合优化镜面和透明物体的照明和参数。为了有效地估计透明物体的参数，考虑人眼的视觉特性，引入心理物理缩放方法，以获得估计折射率的步长。我们在多个真实场景上验证了我们的技术，实验结果表明融合效果在视觉上是一致的。