当前位置: X-MOL 学术arXiv.cs.CV › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Multi-View Photometric Stereo: A Robust Solution and Benchmark Dataset for Spatially Varying Isotropic Materials
arXiv - CS - Computer Vision and Pattern Recognition Pub Date : 2020-01-18 , DOI: arxiv-2001.06659
Min Li, Zhenglong Zhou, Zhe Wu, Boxin Shi, Changyu Diao, and Ping Tan

We present a method to capture both 3D shape and spatially varying reflectance with a multi-view photometric stereo (MVPS) technique that works for general isotropic materials. Our algorithm is suitable for perspective cameras and nearby point light sources. Our data capture setup is simple, which consists of only a digital camera, some LED lights, and an optional automatic turntable. From a single viewpoint, we use a set of photometric stereo images to identify surface points with the same distance to the camera. We collect this information from multiple viewpoints and combine it with structure-from-motion to obtain a precise reconstruction of the complete 3D shape. The spatially varying isotropic bidirectional reflectance distribution function (BRDF) is captured by simultaneously inferring a set of basis BRDFs and their mixing weights at each surface point. In experiments, we demonstrate our algorithm with two different setups: a studio setup for highest precision and a desktop setup for best usability. According to our experiments, under the studio setting, the captured shapes are accurate to 0.5 millimeters and the captured reflectance has a relative root-mean-square error (RMSE) of 9%. We also quantitatively evaluate state-of-the-art MVPS on a newly collected benchmark dataset, which is publicly available for inspiring future research.

中文翻译:

多视图光度立体:空间变化各向同性材料的稳健解决方案和基准数据集

我们提出了一种使用适用于一般各向同性材料的多视图光度立体 (MVPS) 技术捕获 3D 形状和空间变化反射率的方法。我们的算法适用于透视相机和附近的点光源。我们的数据采集设置很简单,只包括一个数码相机、一些 LED 灯和一个可选的自动转盘。从单一的角度来看,我们使用一组光度立体图像来识别与相机距离相同的表面点。我们从多个视点收集这些信息,并将其与来自运动的结构相结合,以获得完整 3D 形状的精确重建。空间变化的各向同性双向反射分布函数 (BRDF) 是通过同时推断一组基础 BRDF 及其在每个表面点处的混合权重来捕获的。在实验中,我们使用两种不同的设置来演示我们的算法:用于最高精度的工作室设置和用于最佳可用性的桌面设置。根据我们的实验,在工作室设置下,捕获的形状精确到 0.5 毫米,捕获的反射率的相对均方根误差 (RMSE) 为 9%。我们还在新收集的基准数据集上定量评估了最先进的 MVPS,该数据集可公开用于启发未来的研究。根据我们的实验,在工作室设置下,捕获的形状精确到 0.5 毫米,捕获的反射率的相对均方根误差 (RMSE) 为 9%。我们还在新收集的基准数据集上定量评估了最先进的 MVPS,该数据集可公开用于启发未来的研究。根据我们的实验,在工作室设置下,捕获的形状精确到 0.5 毫米,捕获的反射率的相对均方根误差 (RMSE) 为 9%。我们还在新收集的基准数据集上定量评估了最先进的 MVPS,该数据集可公开用于启发未来的研究。
更新日期:2020-01-22
down
wechat
bug