Based on the weak regular splitting of tensors, preconditioned technology has shown great advantages in solving tensor equations with nonsingular (strong) ℳ ‐tensors. In this article, we introduce H‐splitting and H‐compatible splitting and investigate the relationship between these different splittings and their convergence. Meanwhile, we also consider a preconditioned AOR iterative method for solving

Nonuniform rational B‐splines (NURBS) are the most common representation form in isogeometric analysis. In this article, we study the spectral behavior of discretization matrices arising from isogeometric Galerkin and collocation methods based on d‐variate NURBS of degrees (p1,…,pd), and applied to general second‐order partial differential equations defined on a d‐dimensional domain. The spectrum of

Block Krylov subspace methods (KSMs) comprise building blocks in many state‐of‐the‐art solvers for large‐scale matrix equations as they arise, for example, from the discretization of partial differential equations. While extended and rational block Krylov subspace methods provide a major reduction in iteration counts over polynomial block KSMs, they also require reliable solvers for the coefficient

Algebraic multigrid (AMG) is a widely used scalable solver and preconditioner for large‐scale linear systems resulting from the discretization of a wide class of elliptic PDEs. While AMG has optimal computational complexity, the cost of communication has become a significant bottleneck that limits its scalability as processor counts continue to grow on modern machines. This article examines the design

We present a greedy algorithm for computing selected eigenpairs of a large sparse matrix H that can exploit localization features of the eigenvector. When the eigenvector to be computed is localized, meaning only a small number of its components have large magnitudes, the proposed algorithm identifies the location of these components in a greedy manner, and obtains approximations to the desired eigenpairs

Following the Perron theorem, the spectral radius of a primitive matrix is a simple eigenvalue. It is shown that for a primitive matrix A, there is a positive rank one matrix X such that B = A ∘ X, where ∘ denotes the Hadamard product of matrices, and such that the row (column) sums of matrix B are the same and equal to the Perron root. An iterative algorithm is presented to obtain matrix B without

The row iterative method is popular in solving the large‐scale ill‐posed problems due to its simplicity and efficiency. In this work we consider the randomized row iterative (RRI) method to tackle this issue. First, we present the semiconvergence analysis of RRI method for the overdetermined and inconsistent system, and derive upper bounds for the noise error propagation in the iteration vectors. To

We investigate the method of conjugate gradients, exploiting inaccurate matrix‐vector products, for the solution of convex quadratic optimization problems. Theoretical performance bounds are derived, and the necessary quantities occurring in the theoretical bounds estimated, leading to a practical algorithm. Numerical experiments suggest that this approach has significant potential, including in the

High‐dimensionality reduction techniques are very important tools in machine learning and data mining. The method of generalized low rank approximations of matrices (GLRAM) is a popular technique for dimensionality reduction and image compression. However, it suffers from heavily computational overhead in practice, especially for data with high dimension. In order to reduce the cost of this algorithm

We propose to reduce the (spectral) condition number of a given linear system by adding a suitable diagonal matrix to the system matrix, in particular by shifting its spectrum. Iterative procedures are then adopted to recover the solution of the original system. The case of real symmetric positive definite matrices is considered in particular, and several numerical examples are given. This approach

In this article, we consider the stochastic inverse singular value problem (ISVP) of constructing a stochastic matrix from the prescribed realizable singular values. We propose a Riemannian inexact Newton‐CG method with various choices of forcing terms for solving the stochastic ISVP. We show the proposed method converges linearly or superlinearly for different forcing terms under some assumptions

The goal of the present paper is the design of embeddings of a general sparse graph into a set of points in ℝ d for appropriate d ≥ 2. The embeddings that we are looking at aim to keep vertices that are grouped in communities together and keep the rest apart. To achieve this property, we utilize coarsening that respects possible community structures of the given graph. We employ a hierarchical multilevel

We construct an algebraic multigrid (AMG) based preconditioner for the reduced Hessian of a linear‐quadratic optimization problem constrained by an elliptic partial differential equation. While the preconditioner generalizes a geometric multigrid preconditioner introduced in earlier works, its construction relies entirely on a standard AMG infrastructure built for solving the forward elliptic equation

The fast Fourier transform (FFT) is one of the most successful numerical algorithms of the 20th century and has found numerous applications in many branches of computational science and engineering. The FFT algorithm can be derived from a particular matrix decomposition of the discrete Fourier transform (DFT) matrix. In this paper, we show that the quantum Fourier transform (QFT) can be derived by

The singular value distribution of the matrix‐sequence {YnTn[f]}n, with Tn[f] generated by f ∈ L 1 ( [ − π , π ] ) , was shown in [J. Pestana and A.J. Wathen, SIAM J Matrix Anal Appl. 2015;36(1):273‐288]. The results on the spectral distribution of {YnTn[f]}n were obtained independently in [M. Mazza and J. Pestana, BIT, 59(2):463‐482, 2019] and [P. Ferrari, I. Furci, S. Hon, M.A. Mursaleen, and S.

Let P(t) be an n × n (complex) exponentially parameterized pentadiagonal matrix. In this article, using a theorem of Akian, Bapat, and Gaubert, we present explicit formulas for asymptotics of the moduli of the eigenvalues of P(t) as t → ∞. Our approach is based on exploiting the relation with tropical algebra and the weighted digraphs of matrices. We prove that this asymptotics tends to a unique limit

Multigrid solvers face multiple challenges on parallel computers. Two fundamental ones read as follows: Multiplicative solvers issue coarse grid solves which exhibit low concurrency and many multigrid implementations suffer from an expensive coarse grid identification phase plus adaptive mesh refinement overhead. We propose a new additive multigrid variant for spacetrees, that is, meshes as they are

Since recent studies have shown that the Cayley transform method can be an effective iterative method for solving the inverse eigenvalue problem, in this work, we consider using an extension of it for solving a type of parameterized generalized inverse eigenvalue problem and prove its locally quadratic convergence. This type of inverse eigenvalue problem, which includes multiplicative and additive

In this paper, preconditioners for the conjugate gradient method are studied to solve the Newton system with symmetric positive definite Jacobian. In particular, we define a sequence of preconditioners built by means of Symmetric Rank one (SR1) and Broyden‐Fletcher‐Goldfarb‐Shanno (BFGS) low‐rank updates. We develop conditions under which the SR1 update maintains the preconditioner symmetric positive

Given a nonsymmetric matrix A ∈ ℝ n × n and two unit norm vectors, the two‐sided Krylov subspace methods construct a pair of bases for two Krylov subspaces with respect to A and AT, respectively. In practical calculations, however, the two subspaces spanned by the computed bases may not be Krylov subspaces. Given two subspaces 𝒦 and ℒ , in [G. Wu et al, Toward backward perturbation bounds for approximate

The notion of the Drazin inverse of an even‐order tensors with the Einstein product was introduced, very recently [J. Ji and Y. Wei. Comput. Math. Appl., 75(9), (2018), pp. 3402‐3413]. In this article, we further elaborate this theory by establishing a few characterizations of the Drazin inverse and 𝒲 ‐weighted Drazin inverse of tensors. In addition to these, we compute the Drazin inverse of tensors

In this article, we generalize modulus‐based synchronous multisplitting methods to horizontal linear complementarity problems. In particular, first we define the methods of our concern and prove their convergence under suitable smoothness assumptions. Particular attention is devoted also to modulus‐based multisplitting accelerated overrelaxation methods. Then, as multisplitting methods are well‐suited

Uncertainty quantification for linear inverse problems remains a challenging task, especially for problems with a very large number of unknown parameters (e.g., dynamic inverse problems) and for problems where computation of the square root and inverse of the prior covariance matrix are not feasible. This work exploits Krylov subspace methods to develop and analyze new techniques for large‐scale uncertainty

This paper addresses the problem of computing the Riemannian center of mass of a collection of symmetric positive definite matrices. We show in detail that the condition number of the Riemannian Hessian of the underlying optimization problem is never very ill conditioned in practice, which explains why the Riemannian steepest descent approach has been observed to perform well. We also show theoretically

The computation of Gauss quadrature rules for arbitrary weight functions using the Stieltjes algorithm is a purely sequential process, and the computational cost significantly increases when high accuracy is required. ParaStieltjes is a new algorithm to compute the recurrence coefficients of the associated orthogonal polynomials in parallel, from which the nodes and weights of the quadrature rule can

We consider the large sparse symmetric linear systems of equations that arise in the solution of weak constraint four‐dimensional variational data assimilation, a method of high interest for numerical weather prediction. These systems can be written as saddle point systems with a 3 × 3 block structure but block eliminations can be performed to reduce them to saddle point systems with a 2 × 2 block

This article develops the preconditioning technique as a method to address the accuracy issue caused by ill‐conditioning. Given a preconditioner M for an ill‐conditioned linear system Ax=b, we show that, if the inverse of the preconditioner M−1 can be applied to vectors accurately, then the linear system can be solved accurately. A stability concept called inverse‐equivalent accuracy is introduced

This article presents a multilevel parallel preconditioning technique for solving general large sparse linear systems of equations. Subdomain coloring is invoked to reorder the coefficient matrix by multicoloring the adjacency graph of the subdomains, resulting in a two‐level block diagonal structure. A full binary tree structure 𝒯 is then built to facilitate the construction of the preconditioner

Multigrid methods are popular solution algorithms for many discretized PDEs, either as standalone iterative solvers or as preconditioners, due to their high efficiency. However, the choice and optimization of multigrid components such as relaxation schemes and grid‐transfer operators is crucial to the design of optimally efficient algorithms. It is well known that local Fourier analysis (LFA) is a

This article presents enhancement strategies for the Hermitian and skew‐Hermitian splitting method based on gradient iterations. The spectral properties are exploited for the parameter estimation, often resulting in a better convergence. In particular, steepest descent with early stopping can generate a rough estimate of the optimal upper bound. This is better than an arbitrary choice since the latter

In the present article, we consider a class of elliptic partial differential equations with Dirichlet boundary conditions and where the operator is div(−a(x)∇·), with a continuous and positive over Ω ‾ , Ω being an open and bounded subset of R d , d≥1. For the numerical approximation, we consider the classical P k Finite Elements, in the case of Friedrichs–Keller triangulations, leading, as usual,

This article develops an algebraic multigrid (AMG) method for solving systems of elliptic boundary‐value problems. It is well known that multigrid for systems of elliptic equations faces many challenges that do not arise for most scalar equations. These challenges include strong intervariable couplings, multidimensional and possibly large near‐nullspaces, analytically unknown near‐nullspaces, delicate

Although convergence of the Parareal and multigrid‐reduction‐in‐time (MGRIT) parallel‐in‐time algorithms is well studied, results on their optimality is limited. Appealing to recently derived tight bounds of two‐level Parareal and MGRIT convergence, this article proves (or disproves) hx‐ and ht‐independent convergence of two‐level Parareal and MGRIT, for linear problems of the form u ′ ( t ) + ℒ u

We present Nesterov‐type acceleration techniques for alternating least squares (ALS) methods applied to canonical tensor decomposition. While Nesterov acceleration turns gradient descent into an optimal first‐order method for convex problems by adding a momentum term with a specific weight sequence, a direct application of this method and weight sequence to ALS results in erratic convergence behavior

In this work we consider the problem of semi‐active damping optimization of mechanical systems with fixed damper positions. Our goal is to compute a damping that is locally optimal with respect to the ℋ ∞ ‐norm of the transfer function from the exogenous inputs to the performance outputs. We make use of a new greedy method for computing the ℋ ∞ ‐norm of a transfer function based on rational interpolation

Lanczos‐type product methods (LTPMs), in which the residuals are defined by the product of stabilizing polynomials and the Bi‐CG residuals, are effective iterative solvers for large sparse nonsymmetric linear systems. Bi‐CGstab(L) and GPBi‐CG are popular LTPMs and can be viewed as two different generalizations of other typical methods, such as CGS, Bi‐CGSTAB, and Bi‐CGStab2. Bi‐CGstab(L) uses stabilizing

In this article, we study robust tensor completion by using transformed tensor singular value decomposition (SVD), which employs unitary transform matrices instead of discrete Fourier transform matrix that is used in the traditional tensor SVD. The main motivation is that a lower tubal rank tensor can be obtained by using other unitary transform matrices than that by using discrete Fourier transform

In the quadratic eigenvalue problem (QEP) with all coefficient matrices symmetric, there can be complex eigenvalues. However, some applications need to compute real eigenvalues only. We propose a Lanczos‐based method for computing all real eigenvalues contained in a given interval of large‐scale symmetric QEPs. The method uses matrix inertias of the quadratic polynomial evaluated at different shift

We describe the numerical scheme for the discretization and solution of 2D elliptic equations with strongly varying piecewise constant coefficients arising in the stochastic homogenization of multiscale composite materials. An efficient stiffness matrix generation scheme based on assembling the local Kronecker product matrices is introduced. The resulting large linear systems of equations are solved

Based on Givens‐like rotations, we present a unitary joint diagonalization algorithm for a set of nonsymmetric higher‐order tensors. Each unitary rotation matrix only depends on one unknown parameter which can be analytically obtained in an independent way following a reasonable assumption and a complex derivative technique. It can serve for the canonical polyadic decomposition of a higher‐order tensor

In this work, we provide new analysis for a preconditioning technique called structured incomplete factorization (SIF) for symmetric positive definite matrices. In this technique, a scaling and compression strategy is applied to construct SIF preconditioners, where off‐diagonal blocks of the original matrix are first scaled and then approximated by low‐rank forms. Some spectral behaviors after applying

Given a system of functions, we introduce the concept of weighted φ‐transformed system, which will include a very large class of useful representations in Statistics and Computer Aided Geometric Design. An accurate bidiagonal decomposition of the collocation matrices of these systems is obtained. This decomposition is used to present computational methods with high relative accuracy for solving algebraic

A combined method consisting of mixed finite element method (MFEM) for the pressure equation and expanded mixed finite element method with characteristics(CEMFEM) for the concentration equation is presented to solve the coupled system of incompressible miscible displacement problem. To solve the resulting nonlinear system of equations efficiently, the two‐grid algorithm relegates all of the Newton‐like

The higher order singular value decomposition, which is regarded as a generalization of the matrix singular value decomposition (SVD), has a long history and is well established, while the T‐SVD is relatively new and lacks systematic analysis. Because of the unusual tensor‐tensor product that the T‐SVD is based on, the form of the T‐SVD may be difficult to comprehend. The main aim of this article is

Tensor decompositions such as the canonical format and the tensor train format have been widely utilized to reduce storage costs and operational complexities for high‐dimensional data, achieving linear scaling with the input dimension instead of exponential scaling. In this paper, we investigate even lower storage‐cost representations in the tensor ring format, which is an extension of the tensor train

A definition for functions of multidimensional arrays is presented. The definition is valid for third‐order tensors in the tensor t‐product formalism, which regards third‐order tensors as block circulant matrices. The tensor function definition is shown to have similar properties as standard matrix function definitions in fundamental scenarios. To demonstrate the definition's potential in applications

In this paper, we employ local Fourier analysis (LFA) to analyze the convergence properties of multigrid methods for higher‐order finite‐element approximations to the Laplacian problem. We find that the classical LFA smoothing factor, where the coarse‐grid correction is assumed to be an ideal operator that annihilates the low‐frequency error components and leaves the high‐frequency components unchanged

This paper is concerned with computing 𝒵 ‐eigenpairs of symmetric tensors. We first show that computing 𝒵 ‐eigenpairs of a symmetric tensor is equivalent to finding the nonzero solutions of a nonlinear system of equations, and then propose a modified normalized Newton method (MNNM) for it. Our proposed MNNM method is proved to be locally and cubically convergent under some suitable conditions, which

Some mathematical models of applied problems lead to the need of solving boundary value problems with a fractional power of an elliptic operator. In a number of works, approximations of such a nonlocal operator are constructed on the basis of an integral representation with a singular integrand. In the present article, new integral representations are proposed for operators with fractional powers.

This article is devoted to the efficient numerical solution of the Helmholtz equation in a two‐ or three‐dimensional (2D or 3D) rectangular domain with an absorbing boundary condition (ABC). The Helmholtz problem is discretized by standard bilinear and trilinear finite elements on an orthogonal mesh yielding a separable system of linear equations. The main key to high performance is to employ the fast

We consider solving large sparse symmetric singular linear systems. We first introduce an algorithm for right preconditioned minimum residual (MINRES) and prove that its iterates converge to the preconditioner weighted least squares solution without breakdown for an arbitrary right‐hand‐side vector and an arbitrary initial vector even if the linear system is singular and inconsistent. For the special

Nonnegative tensors arise very naturally in many applications that involve large and complex data flows. Due to the relatively small requirement in terms of memory storage and number of operations per step, the (shifted) higher order power method is one of the most commonly used technique for the computation of positive Z‐eigenvectors of this type of tensors. However, unlike the matrix case, the method

In this paper, we propose an efficient numerical scheme for solving some large‐scale ill‐posed linear inverse problems arising from image restoration. In order to accelerate the computation, two different hidden structures are exploited. First, the coefficient matrix is approximated as the sum of a small number of Kronecker products. This procedure not only introduces one more level of parallelism

Convergence of both synchronous and asynchronous optimized Schwarz algorithms for the shifted Laplacian operator on a bounded rectangular domain, in a one‐way subdivision of the computational domain, with overlap, is shown. Convergence results are obtained under very mild conditions on the size of the subdomains and on the amount of overlap. A couple of results are also given, relating the convergence