Robust and globally efficient reduction of parametric, highly nonlinear computational models and real time online performance☆
Introduction
While computational models in structural dynamics, fluid dynamics, and other engineering and scientific fields can circumvent the need for expensive experiments such as frontal barrier impact and wind tunnel tests, the computational cost of fully resolved numerical models is often intractable. Modeling simplifications and assumptions such as, in the case of computational fluid dynamics (CFD), turbulence and near-wall modeling or inviscid and incompressible flows, can decrease the computational cost without compromising accuracy — when performed appropriately. However, the computational cost of high-fidelity, high-dimensional models (HDMs) often remains prohibitive for many parametric applications such as the modeling and quantification of model-form uncertainty [1], routine analysis, and design optimization. Projection-based model order reduction (PMOR) is a promising computational technology for enabling such applications, starting from a parametric HDM of interest whose dimension is denoted throughout this paper by . It creates surrogate models that take advantage of the lower dimensionality of the manifold of the HDM-based solutions. Specifically, it produces projection-based reduced-order models (PROMs) of much lower dimension . Unlike regression-based approaches for constructing data fitting surrogate models, a PMOR method incorporates the physics underlying a HDM by projecting it onto a subspace of much smaller dimension, using typically an affine approximation based a properly trained reduced-order basis : this enables it to deliver accurate predictions for any quantity of interest (QoI) not explicitly accounted for during training. In order to capitalize on the lower dimensionality of a subspace and translate it into a lower computational cost, including in the parametric setting, hyperreduction is often invoked for approximating projected (or reduced) quantities. In this case, a nonlinear PROM is transformed into a computationally efficient and yet accurate hyperreduced PROM (HPROM). This paper presents a methodology for constructing a “globally efficient” HPROM for parametric, nonlinear, static or steady-state applications in computational mechanics, that is practical in engineering environments. For this purpose, it focuses on the reduction of the offline costs associated with an iterative, adaptive procedure for constructing a nonlinear HPROM; the enhancement of the accuracy and computational efficiency of the hyperreduction training; the proper scaling of a nonlinear HPROM; and on the efficient initialization of a Newton-like solution procedure during the online execution of a nonlinear, implicit, discrete HPROM.
Usually, the computational complexity of the construction of a parametric PROM of dimension scales with both and the larger dimension of the underlying HDM. For the class of parametric, linear HDMs admitting an efficient parameter-affine representation and that of parametric or nonparametric nonlinear HDMs with a low-order polynomial dependence on the solution, this issue can be addressed by precomputing those reduced-order quantities whose computational complexities scale with [2], [3], [4], [5]. Lifting transformations [6] can sometimes be used to treat the case of nonpolynomial nonlinearities (for example, see [7]), but hyperreduction [5] is typically required in all other cases to achieve a computational complexity that, in the worst case, scales as during the online evaluation of the reduced-order quantities.
One class of hyperreduction methods described in [5] as methods of the approximate-then-project type, originated in image-reconstruction algorithms such as the gappy proper orthogonal decomposition (POD) method [8]. They first approximate a nonlinear high-dimensional quantity, for example, by interpolating a subset of carefully selected degrees of freedom, then project it on the subspace represented by the right ROB . Examples include the empirical interpolation method (EIM) [9], the collocation method [10], and the discrete empirical interpolation method (DEIM) [11] – which is arguably the most popular hyperreduction method of this type. The other class of hyperreduction methods, described in [5] as methods of the project-then-approximate type, have been more recently developed: they seek to approximate directly the reduced-order quantities. Often, they can be interpreted as generalized quadrature rules. They include the cubature-based approach developed for computational graphics [12], the energy-conserving sampling and weighting (ECSW) method [13], the empirical cubature method (ECM) [14], and the linear program-based empirical quadrature method [15]. ECSW, is adopted in this paper for the following three reasons. Firstly, it features for Galerkin PROMs associated with second-order dynamical systems such as those that arise in structural dynamics, unique and attractive numerical stability properties that have been demonstrated at both the theoretical and numerical levels, for large-scale applications [16]. Secondly, ECSW has been recently extended in [17] to Petrov–Galerkin PROMs — which have been shown to demonstrate in practice and for many applications better numerical stability properties than their Galerkin counterparts [18], [19], [20]. In particular, ECSW was extended in [17] to nonlinear PROMs generated by the least squares Petrov–Galerkin (LSPG) PMOR method, which is notorious for its robustness and superior performance for convection dominated turbulent flow problems [20], [21]; and achieved for a large-scale turbulent flow application of industrial relevance three and five orders of magnitude speedup factors for the wall-clock and CPU solution times.
To achieve robustness in a parameter domain , the ROB underlying a nonlinear PROM is usually trained in this domain using an iterative parameter sampling procedure known as a greedy procedure. At each iteration, such a procedure adaptively selects the next parameter point to sample in , based on feedback information generated by an error indicator; exercises the parametric HDM at the sampled parameter point to compute at this point one or several solution snapshots; and then rebuilds the ROB . The achieve computational tractability, at each iteration, the error indicator needs to approximate the HDM-based solution at number of different test points in . Whether these are preselected or randomly regenerated at each iteration, computational tractability calls for computing the approximate solutions used by the error indicator using an HPROM. For this reason, a greedy sampling procedure entails in general repetitive rebuilds of an HPROM, which increases the offline computational cost of PMOR. A first contribution of this paper is the reduction of that cost by enabling rebuilding an HPROM only as needed.
As proposed in [13], [17], the hyperreduction method ECSW is itself trained with the residuals of the solution snapshots computed during a greedy sampling procedure, or a subset of them. However, in many circumstances that are identified in this paper, these residuals are close to zero, in which case ECSW is poorly trained. Hence, a second contribution of this paper is the more accurate and computationally efficient training of ECSW using instead the Jacobians of the residuals (which are readily available in implicit computations).
A third contribution of this paper is the demonstration for a large-scale, industrial-grade, parametric, nonlinear application, that the two aforementioned contributions equipped with of a proper scaling procedure for the construction of a nonlinear, implicit, discrete HPROM and an efficient initialization of a Newton-like solution procedure during its online execution lead to a globally efficient approach for performing nonlinear PMOR — that is, an approach that makes both offline and online stages of PMOR practical in today’s engineering environments.
Due to space limitation and for the reasons highlighted above, the contributions of this paper are presented in the contexts of steady-state CFD problems, the nonlinear PMOR method LSPG, and the hyperreduction method ECSW. However, they are equally applicable, in principle, to unsteady CFD problems and many other areas of computational mechanics including computational structural and solid mechanics problems, and using many other PMOR and hyperreduction methods.
The remainder of this paper is organized as follows. Section 2 formalizes the contexts specified above in order to keep this paper as self-contained as possible. Section 3 revisits the hyperreduction method ECSW, presents a better approach for training it based on residual Jacobians, and describes a computational strategy for reducing its overall cost when implemented within a greedy sampling procedure. Section 4 demonstrates all contributions of this paper for two different CFD applications: a relatively simple one that has the merit of being easily reproducible by the interested reader; and an industrial-grade CFD application that highlights the merits of the proposed advancements of the state of the art of parametric, nonlinear PMOR. Finally, Section 5 concludes this paper.
Section snippets
Nonlinear PMOR in the parametric setting
In general, the semi-discretization of a -parametric partial-differential equation (PDE) with arbitrary-order time derivatives and its initial condition can be written or re-written in first-order form as where denotes time, a -dimensional vector of parameters, a bounded parameter domain of interest, a time-dependent solution vector, its initial condition, an matrix, and a nonlinear function of
Practical and efficient hyperreduction of nonlinear PROMs
Here, the hyperreduction method ECSW is first reviewed. Then, a new approach for training this method is proposed. The presentation is made in the general context of the Petrov–Galerkin projection, which includes the Galerkin projection as a particular case.
Applications
Two parametric compressible flow applications are presented here to illustrate the contributions of this paper and demonstrate their potential: one where the compressible flow is assumed to be inviscid and is modeled by the Euler equations; and a second application where the compressible flow is viscous and modeled by the Reynolds-averaged Navier–Stokes equations (RANS) equipped with the Spalart–Allmaras (SA) turbulence model. All offline and online computations are performed using a Python
Conclusions
In projection-based model order reduction (PMOR), hyperreduction is essential for achieving computational efficiency when the high-dimensional computational model (HDM) is parametric and linear, but does not admit an efficient parameter-affine representation; or the HDM is parametric or nonparametric, but nonlinear and characterized by a higher-order polynomial or a nonpolynomial dependence on the solution. For many applications in computational mechanics and particularly for those grounded in
Declaration of Competing Interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Acknowledgments
The authors acknowledge partial support by the Air Force Office of Scientific Research under Grant FA9550-20-1-0286 and Grant FA9550-20-1-0358, and partial support by the National Science Foundation under Grant number 1937129.
References (37)
- et al.
Model reduction for compressible flows using POD and Galerkin projection
Physica D
(2004) - et al.
An ‘empirical interpolation’ method: Application to efficient reduced-basis discretization of partial differential equations
C. R. Math.
(2004) A priori hyperreduction method: An adaptive approach
J. Comput. Phys.
(2005)- et al.
Dimensional hyper-reduction of nonlinear finite element models via empirical cubature
Comput. Methods Appl. Mech. Engrg.
(2017) - et al.
An LP empirical cubature procedure for reduced basis treatment of parametrized nonlinear PDEs
Comput. Methods Appl. Mech. Engrg.
(2019) - et al.
On the stability of projection-based model order reduction for convection-dominated laminar and turbulent flows
J. Comput. Phys.
(2020) - et al.
The GNAT method for nonlinear model reduction: Effective implementation and application to computational fluid dynamics and turbulent flows
J. Comput. Phys.
(2013) - et al.
Reduction of nonlinear embedded boundary models for problems with evolving interfaces
J. Comput. Phys.
(2014) - et al.
A nonparametric probabilistic approach for quantifying uncertainties in low-dimensional and high-dimensional nonlinear models
Internat. J. Numer. Methods Engrg.
(2017) - et al.
Real-time subspace integration for St. Venant-Kirchoff deformable models
ACM Trans. Graph.
(2005)
A survey of projection-based model reduction methods for parametric dynamical systems
SIAM Rev.
Computational bottlenecks for proms: precomputation and hyperreduction
QLMOR: A projection-based nonlinear model order reduction approach using quadratic-linear representation of nonlinear systems
IEEE Trans. Comput.-Aided Des. Integr. Circuits Syst.
Nonlinear model order reduction via lifting transformations and proper orthogonal decomposition
AIAA J.
Karhunen-Loève procedure for gappy data
J. Opt. Soc. Amer. A
Nonlinear model reduction via discrete empirical interpolation
SIAM J. Sci. Comput.
Optimizing cubature for the efficient integration of subspace deformations
ACM Trans. Graph.
Dimensional reduction of nonlinear finite element dynamic models with finite rotations and energy-based mesh sampling and weighting for computational efficiency
Internat. J. Numer. Methods Engrg.
Cited by (7)
Neural-network-augmented projection-based model order reduction for mitigating the Kolmogorov barrier to reducibility
2023, Journal of Computational PhysicsPredictive reduced order modeling of chaotic multi-scale problems using adaptively sampled projections
2023, Journal of Computational PhysicsA posteriori error estimation for model order reduction of parametric systems
2024, Advanced Modeling and Simulation in Engineering SciencesRhenium-Free Heat-Resistant Nickel Alloy for the Cast Blades Production
2024, Minerals, Metals and Materials SeriesA Posteriori Error Estimation for Model Order Reduction of Parametric Systems
2023, Research Square
- ☆
A Special Issue in Honor of the Lifetime Achievements of J. Tinsley Oden.