Reflectance and shape are two important components in visually perceiving the real world. Inferring the reflectance and shape of an object through cameras is a fundamental research topic in the field of computer vision. While three-dimensional shape recovery is pervasive with varieties of approaches and practical applications, reflectance recovery has only emerged recently. Reflectance recovery is a challenging task that is usually conducted in controlled environments, such as a laboratory environment with a special apparatus. However, it is desirable that the reflectance be recovered in the field with a handy camera so that reflectance can be jointly recovered with the shape. To that end, we present a solution that simultaneously recovers the reflectance and shape (i.e., dense depth and normal maps) of an object under natural illumination with commercially available handy cameras. We employ a light field camera to capture one light field image of the object, and a 360-degree camera to capture the illumination. The proposed method provides positive results in both simulation and real-world experiments.

中文翻译：

---

自然光照下光场相机的反射率和形状估计

反射率和形状是视觉感知现实世界的两个重要组成部分。通过相机推断物体的反射率和形状是计算机视觉领域的基础研究课题。虽然三维形状恢复在各种方法和实际应用中无处不在，但反射恢复只是最近才出现。反射恢复是一项具有挑战性的任务，通常在受控环境中进行，例如具有特殊设备的实验室环境。然而，希望在现场使用便携式相机恢复反射率，以便反射率可以与形状一起恢复。为此，我们提出了一种同时恢复反射率和形状的解决方案（即，密集深度和法线贴图）自然光照下的物体，使用市售的便携式相机。我们使用光场相机捕捉物体的一个光场图像，并使用 360 度相机捕捉照明。所提出的方法在模拟和现实世界的实验中都提供了积极的结果。