In this article, we propose the novel folding patch model which can replace the traditional patch model utilized in patch‐based multiview stereo (MVS) methods to significantly improve the reconstruction results. The patch model is applied as an approximation of the scene surface differential in the geometric estimation procedure. By minimizing the photometric discrepancy of the projection of the patch model on multiple source images, patch‐based MVS algorithms optimize the position and normal values for the 3D hypothesis of the target pixel. The optimization is based on the assumption that the patch model can fit the target scene surface perfectly. However, when it comes to complex scenes crowded with sharp edges, splintery surfaces, or round surfaces, the patch model is inherently not suitable since even from the microscopic perspective these surfaces are not entirely flat. We construct the folding patch model by folding the traditional patch model from the middle line. By adjusting the folding angle and direction, the folding patch model can fit complex surfaces more flexibly. We apply our folding patch model to the representative open‐source patch based multiview stereo (PMVS) and COLMAP, and validate the effectiveness on ETH3D benchmark and data sets captured in nature. The results demonstrate that utilizing the folding patch model can significantly improve the behavior of PMVS and COLMAP, especially on data sets mainly consist of complex surfaces from plants.

中文翻译：

---

多视点立体的折叠贴片对应

在本文中，我们提出了一种新颖的折叠补丁模型，它可以取代基于补丁的多视图立体（MVS）方法中使用的传统补丁模型，以显着改善重建结果。在几何估计过程中，补丁模型被用作场景表面差异的近似值。通过最小化补丁模型在多个源图像上的投影的光度差异，基于补丁的 MVS 算法优化了目标像素的 3D 假设的位置和法线值。优化基于补丁模型可以完美拟合目标场景表面的假设。但是，当涉及到边缘尖锐、表面粗糙或圆润的复杂场景时，补丁模型本质上是不合适的，因为即使从微观角度来看，这些表面也不是完全平坦的。我们通过从中间线折叠传统补丁模型来构建折叠补丁模型。通过调整折叠角度和方向，折叠贴片模型可以更灵活地拟合复杂曲面。我们将折叠补丁模型应用于代表性的基于开源补丁的多视图立体 (PMVS) 和 COLMAP，并验证在 ETH3D 基准测试和自然界捕获的数据集上的有效性。结果表明，利用折叠补丁模型可以显着改善 PMVS 和 COLMAP 的行为，尤其是在主要由植物复杂表面组成的数据集上。通过调整折叠角度和方向，折叠贴片模型可以更灵活地拟合复杂曲面。我们将折叠补丁模型应用于代表性的基于开源补丁的多视图立体 (PMVS) 和 COLMAP，并验证在 ETH3D 基准测试和自然界捕获的数据集上的有效性。结果表明，利用折叠补丁模型可以显着改善 PMVS 和 COLMAP 的行为，尤其是在主要由植物复杂表面组成的数据集上。通过调整折叠角度和方向，折叠贴片模型可以更灵活地拟合复杂曲面。我们将折叠补丁模型应用于代表性的基于开源补丁的多视图立体 (PMVS) 和 COLMAP，并验证在 ETH3D 基准测试和自然界捕获的数据集上的有效性。结果表明，利用折叠补丁模型可以显着改善 PMVS 和 COLMAP 的行为，尤其是在主要由植物复杂表面组成的数据集上。