Abstract
In a previous paper (Adcock and Huybrechs in SIAM Rev 61(3):443–473, 2019) we described the numerical approximation of functions using redundant sets and frames. Redundancy in the function representation offers enormous flexibility compared to using a basis, but ill-conditioning often prevents the numerical computation of best approximations. We showed that, in spite of said ill-conditioning, approximations with regularization may still provide accuracy up to order \(\sqrt{\epsilon }\), where \(\epsilon \) is a small truncation threshold. When using frames, i.e. complete systems that are generally redundant but which provide infinite representations with coefficients of bounded norm, this accuracy can actually be achieved for all functions in a space. Here, we generalize that setting in two ways. We assume information or samples from f from a wide class of linear operators acting on f, rather than inner products associated with the best approximation projection. This enables the analysis of fully discrete approximations based, for instance, on function values only. Next, we allow oversampling, leading to least-squares approximations. We show that this leads to much improved accuracy on the order of \(\epsilon \) rather than \(\sqrt{\epsilon }\). Overall, we demonstrate that numerical function approximation using redundant representations may lead to highly accurate approximations in spite of having to solve ill-conditioned systems of equations.
Similar content being viewed by others
References
Adcock, B., Hansen, A.C.: A generalized sampling theorem for stable reconstructions in arbitrary bases. J. Fourier Anal. Appl. 18(4), 685–716 (2012)
Adcock, B., Hansen, A.C.: Stable reconstructions in Hilbert spaces and the resolution of the Gibbs phenomenon. Appl. Comput. Harmon. Anal. 32(3), 357–388 (2012)
Adcock, B., Huybrechs, D.: Frames and numerical approximation. SIAM Rev. 61(3), 443–473 (2019)
Adcock, B., Hansen, A.C., Poon, C.: Beyond consistent reconstructions: optimality and sharp bounds for generalized sampling, and application to the uniform resampling problem. SIAM J. Math. Anal. 45(5), 3114–3131 (2013)
Adcock, B., Huybrechs, D., Martín-Vaquero, J.: On the numerical stability of Fourier extensions. Found. Comput. Math. 14(4), 635–687 (2014)
Boffi, D., Cavallini, N., Gastaldi, L.: The finite element immersed boundary method with distributed Lagrange multiplier. SIAM J. Numer. Anal. 53(6), 2584–2604 (2015)
Christensen, O.: An Introduction to Frames and Riesz Bases. Applied and Numerical Harmonic Analysis, 2nd edn. Birkhäuser, Basel (2016)
Coppé, V., Huybrechs, D.: Efficient function approximation on general bounded domains using splines on a cartesian grid. Technical Report, KU Leuven. arXiv:1911.07894 (2020)
Coppé, V., Huybrechs, D., Matthysen, R., Webb, M.: The AZ algorithm for least squares problems with a known incomplete generalized inverse. SIAM J. Math. Anal. Appl. 41(3), 1237–1259 (2020)
Fix, G.J., Gulati, S., Wakoff, G.I.: On the use of singular functions with finite elements approximations. J. Comput. Phys. 1, 209–228 (1973)
Golub, G.H., van Loan, C.F.: Matrix Computations, 3rd edn. Johns Hopkins University Press, Baltimore (1996)
Gröchenig, K.: Sampling, Marcinkiewicz–Zygmund inequalities, approximation, and quadrature rules. J. Approx. Theory 257, 105455 (2020)
Hansen, A.C.: On the solvability complexity index, the n-pseudospectrum and approximations of spectra of operators. J. Am. Math. Soc. 24(1), 81–124 (2011)
Heinemeyer, E., Lindner, M., Potthast, R.: Convergence and numerics of a multisection method for scattering by three-dimensional rough surfaces. SIAM J. Numer. Anal. 46(4), 1780–1798 (2008)
Huybrechs, D.: On the Fourier extension of non-periodic functions. SIAM J. Numer. Anal. 47(6), 4326–4355 (2010)
Huybrechs, D., Olteanu, A.-E.: An oversampled collocation approach of the wave based method for Helmholtz problems. Wave Motion 87, 92–105 (2019)
Kasolis, F., Wadbro, E., Berggren, M.: Analysis of fictitious domain approximations of hard scatterers. SIAM J. Numer. Anal. 2015(5), 2347–2362 (2015)
Lindner, M.: Infinite Matrices and their Finite Sections. Frontiers in Mathematics. Birkhäuser, Basel (2006)
Lubinsky, D.S.: Marcinkiewicz–Zygmund Inequalities: Methods and Results, pp. 213–240. Springer, Dordrecht (1998)
Lyon, M.: A fast algorithm for Fourier continuation. SIAM J. Sci. Comput. 33(6), 3241–3260 (2012)
Matthysen, R., Huybrechs, D.: Fast algorithms for the computation of Fourier extensions of arbitrary length. SIAM J. Sci. Comput. 38(2), A899–A922 (2016)
Matthysen, R., Huybrechs, D.: Function approximation on arbitrary domains using fourier frames. SIAM J. Numer. Anal. 56, 1360–1385 (2018)
Roache, P.J.: A pseudo-spectral FFT technique for non-periodic problems. J. Comput. Phys. 27, 204–220 (1978)
Shirokoff, D., Nave, J.-C.: A sharp-interface active penalty method for the incompressible Navier–Stokes equations. J. Sci. Comput. 62(1), 53–77 (2015)
Acknowledgements
A preliminary version of this work was presented during the Research Cluster on “Computational Challenges in Sparse and Redundant Representations” at ICERM in November 2014. The authors would like to thank all the participants for the useful discussions and feedback received during the programme. The first author would also like to thank Juan M. Cardenas and Sebastian Moraga. The first author is supported by NSERC Grant 611675, as well as an Alfred P. Sloan Research Fellowship The second author is supported by FWO-Flanders projects G.0641.11, G.A004.14 and by KU Leuven Project C14/15/055.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Akram Aldroubi.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Adcock, B., Huybrechs, D. Frames and Numerical Approximation II: Generalized Sampling. J Fourier Anal Appl 26, 87 (2020). https://doi.org/10.1007/s00041-020-09796-w
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00041-020-09796-w