当前位置: X-MOL 学术Numer. Math. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
On the convergence of the Laplace approximation and noise-level-robustness of Laplace-based Monte Carlo methods for Bayesian inverse problems
Numerische Mathematik ( IF 2.1 ) Pub Date : 2020-07-13 , DOI: 10.1007/s00211-020-01131-1
Claudia Schillings , Björn Sprungk , Philipp Wacker

The Bayesian approach to inverse problems provides a rigorous framework for the incorporation and quantification of uncertainties in measurements, parameters and models. We are interested in designing numerical methods which are robust w.r.t. the size of the observational noise, i.e., methods which behave well in case of concentrated posterior measures. The concentration of the posterior is a highly desirable situation in practice, since it relates to informative or large data. However, it can pose a computational challenge for numerical methods based on the prior or reference measure. We propose to employ the Laplace approximation of the posterior as the base measure for numerical integration in this context. The Laplace approximation is a Gaussian measure centered at the maximum a-posteriori estimate and with covariance matrix depending on the logposterior density. We discuss convergence results of the Laplace approximation in terms of the Hellinger distance and analyze the efficiency of Monte Carlo methods based on it. In particular, we show that Laplace-based importance sampling and Laplace-based quasi-Monte-Carlo methods are robust w.r.t. the concentration of the posterior for large classes of posterior distributions and integrands whereas prior-based importance sampling and plain quasi-Monte Carlo are not. Numerical experiments are presented to illustrate the theoretical findings.

中文翻译:

关于贝叶斯逆问题的拉普拉斯近似和基于拉普拉斯的蒙特卡罗方法的噪声级鲁棒性的收敛性

逆问题的贝叶斯方法为测量、参数和模型中不确定性的合并和量化提供了严格的框架。我们感兴趣的是设计在观测噪声的大小下具有鲁棒性的数值方法,即在集中后验测量的情况下表现良好的方法。后验的集中在实践中是非常理想的情况,因为它涉及信息量大的数据。然而,它可能会给基于先验或参考度量的数值方法带来计算挑战。我们建议在这种情况下使用后验的拉普拉斯近似作为数值积分的基本度量。拉普拉斯近似是一种高斯度量,以最大后验估计为中心,协方差矩阵取决于对数后验密度。我们根据海灵格距离讨论拉普拉斯近似的收敛结果,并分析基于它的蒙特卡罗方法的效率。特别是,我们证明了基于拉普拉斯的重要性采样和基于拉普拉斯的准蒙特卡罗方法在大类后验分布和被积函数的后验集中度方面是稳健的,而基于先验的重要性采样和简单的准蒙特卡罗方法是不是。给出了数值实验来说明理论发现。我们根据海灵格距离讨论拉普拉斯近似的收敛结果,并分析基于它的蒙特卡罗方法的效率。特别是,我们证明了基于拉普拉斯的重要性采样和基于拉普拉斯的准蒙特卡罗方法在大类后验分布和被积函数的后验集中度方面是稳健的,而基于先验的重要性采样和简单的准蒙特卡罗方法是不是。给出了数值实验来说明理论发现。我们根据海灵格距离讨论拉普拉斯近似的收敛结果,并分析基于它的蒙特卡罗方法的效率。特别是,我们证明了基于拉普拉斯的重要性采样和基于拉普拉斯的准蒙特卡罗方法在大类后验分布和被积函数的后验集中度方面是稳健的,而基于先验的重要性采样和简单的准蒙特卡罗方法是不是。给出了数值实验来说明理论发现。
更新日期:2020-07-13
down
wechat
bug