当前位置: X-MOL 学术ISPRS J. Photogramm. Remote Sens. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Aleatoric uncertainty estimation for dense stereo matching via CNN-based cost volume analysis
ISPRS Journal of Photogrammetry and Remote Sensing ( IF 12.7 ) Pub Date : 2020-11-18 , DOI: 10.1016/j.isprsjprs.2020.11.003
Max Mehltretter , Christian Heipke

Motivated by the need to identify erroneous disparity estimates, various methods for the estimation of aleatoric uncertainty in the context of dense stereo matching have been presented in recent years. Especially, the introduction of deep learning based methods and the accompanying significant improvement in accuracy have greatly increased the popularity of this field. Despite this remarkable development, most of these methods rely on features learned from disparity maps only, neglecting the corresponding 3-dimensional cost volumes. However, conventional hand-crafted methods have already demonstrated that the additional information contained in such cost volumes are beneficial for the task of uncertainty estimation. In this paper, we combine the advantages of deep learning and cost volume based features and present a new Convolutional Neural Network (CNN) architecture to directly learn features for the task of aleatoric uncertainty estimation from volumetric 3D data. Furthermore, we discuss and apply three different uncertainty models to train our CNN without the need to provide ground truth for uncertainty. In an extensive evaluation on three datasets using three common dense stereo matching methods, we investigate the effects of these uncertainty models and demonstrate the generality and state-of-the-art accuracy of the proposed method.



中文翻译:

通过基于CNN的成本量分析进行密集立体声匹配的运动不确定性估计

由于需要识别错误的视差估计值,近年来,在密集的立体匹配的背景下,已经出现了各种用于估计不确定性的方法。特别是,基于深度学习的方法的引入以及随之而来的准确性的显着提高极大地提高了该领域的知名度。尽管取得了令人瞩目的发展,但是这些方法中的大多数仅依赖于从视差图中学习的功能,而忽略了相应的3维成本量。但是,传统的手工方法已经证明,包含在这种成本量中的附加信息对于不确定性估计是有益的。在本文中,我们结合了深度学习和基于成本量特征的优势,并提出了一种新的卷积神经网络(CNN)架构,可以直接从体积3D数据中学习用于不确定性估计任务的特征。此外,我们讨论并应用了三种不同的不确定性模型来训练CNN,而无需提供不确定性的基本事实。在使用三种常见的密集立体匹配方法对三个数据集进行的广泛评估中,我们研究了这些不确定性模型的影响,并证明了该方法的通用性和最新的准确性。我们讨论并应用了三种不同的不确定性模型来训练我们的CNN,而无需提供不确定性的基本事实。在使用三种常见的密集立体匹配方法对三个数据集进行的广泛评估中,我们研究了这些不确定性模型的影响,并证明了该方法的通用性和最新的准确性。我们讨论并应用了三种不同的不确定性模型来训练我们的CNN,而无需提供不确定性的基本事实。在使用三种常见的密集立体匹配方法对三个数据集进行的广泛评估中,我们研究了这些不确定性模型的影响,并证明了该方法的通用性和最新的准确性。

更新日期:2020-11-18
down
wechat
bug