Several efficient iterative algorithms for solving nonlinear tensor equation with Einstein product

Raziyeh Erfanifar,Masoud Hajarian

DOI: https://doi.org/10.1007/s40314-024-02602-z

2024-02-10

Computational and Applied Mathematics

Abstract:In this paper, we initially introduce several theoretical results regarding the existence of solutions for the nonlinear tensor equation

mathematics, applied

What problem does this paper attempt to address?

On sign function of tensors with Einstein product and its application in solving Yang–Baxter tensor equation

Raziyeh Erfanifar,Masoud Hajarian

DOI: https://doi.org/10.1007/s40314-024-02892-3

2024-08-19

Computational and Applied Mathematics

Abstract:In recent years, tensor problems have been studied in multiple fields of science and engineering including applied mathematics, the theory of completely integrable quantum, data mining, statistics, physics, chemistry, machine learning, medical engineering, and others. In machine learning, the word tensor informally refers to two different concepts that organize and represent data. In this work, at first, the concept of the sign function of a tensor is developed using the sign function of a matrix. Then, we propose an iterative method to find the sign function of a tensor. We prove that the order of convergence of the proposed method is three. Finally, we extend the iterative method for solving the Young–Baxter equation, which has many applications in fully integrable quantum theory, classical systems, and exactly solvable models of statistical physics. The accuracy and effectiveness of the proposed method in comparison to well-known methods are demonstrated by various numerical examples.

mathematics, applied
Solutions of linear and non-linear partial differential equations by means of tensor product theory of Banach space

Waseem Ghazi Alshanti

DOI: https://doi.org/10.58997/ejde.2024.28

2024-03-29

Electronic journal of differential equations

Abstract:In this article, we introduce an analytical method for solving both non-separable linear and non-linear partial differential equations, for which separation of variables method does not work. This method is based on the theory of tensor product in Banach spaces coupled with some properties of atoms operators. We provide some illustrative examples. For more information see https://ejde.math.txstate.edu/Volumes/2024/28/abstr.html

mathematics, applied
Computing Symmetric Positive Definite Solutions of Three Types of Nonlinear Matrix Equations

Negin Bagherpour,Nezam Mahdavi-Amiri

DOI: https://doi.org/10.48550/arXiv.1410.5559

2014-10-21

Abstract:Nonlinear matrix equations arise in many practical contexts related to control theory, dynamical programming and finite element methods for solving some partial differential equations. In most of these applications, it is needed to compute a symmetric and positive definite solution. Here, we propose new iterative algorithms for solving three different types of nonlinear matrix equations. We have recently proposed a new algorithm for solving positive definite total least squares problems. Making use of an iterative process for inverse of a matrix, we convert the nonlinear matrix equation to an iterative linear one, and, in every iteration, we apply our algorithm for solving a positive definite total least squares problem to solve the linear subproblem and update the newly defined variables and the matrix inverse terms using appropriate formulas. Our proposed algorithms have a number of useful features. One is that the computed unknown matrix remains symmetric and positive definite in all iterations. As the second useful feature, numerical test results show that in most cases our proposed approach turns to compute solutions with smaller errors within lower computing times. Finally, we provide some test results showing that our proposed algorithm converges to a symmetric and positive definite solution in Matlab software environment on a PC, while other methods fail to do so.

Numerical Analysis
Numerical solution to a linear equation with tensor product structure.

Hung-Yuan Fan,Liping Zhang,Eric King-Wah Chu,Yimin Wei

DOI: https://doi.org/10.1002/nla.2106

2017-01-01

Numerical Linear Algebra with Applications

Abstract:We consider the numerical solution of a c-stable linear equation in the tensor product space R-n1x . . .xnd, arising from a discretized elliptic partial differential equation in R-d. Utilizing the stability, we produce an equivalent d-stable generalized Stein-like equation, which can be solved iteratively. For large-scale problems defined by sparse and structured matrices, the methods can be modified for further efficiency, producing algorithms of O(Sigma(i)n(i)) + O(n(s)) computational complexity, under appropriate assumptions (with n(s) being the flop count for solving a linear system associated with (A(i) - gamma I-ni). Illustrative numerical examples will be presented.
Developing iterative algorithms to solve Sylvester tensor equations

Xin-Fang Zhang,Qing-Wen Wang

DOI: https://doi.org/10.1016/j.amc.2021.126403

IF: 4.397

2021-11-01

Applied Mathematics and Computation

Abstract:<p>This paper is concerned with solving high order Sylvester tensor equation arising in control theory. We propose the tensor forms of the bi-conjugate gradient and bi-conjugate residual methods for solving the tensor equation. To improve their performance, two preconditioned iterative algorithms based on the nearest Kronecker product are developed for finding its solution. We also prove that the proposed algorithms are convergent to an exact solution within finite iteration steps for any initial tensor in the absence of round-off errors. At last, some numerical examples are provided to illustrate the feasibility and validity of the algorithms proposed.</p>

mathematics, applied
Nonsymmetric Algebraic Riccati Equations under the Tensor Product

Xiongyu Shao,Yimin Wei,Jin-Yun Yuan

DOI: https://doi.org/10.1080/01630563.2023.2192593

2023-01-01

Numerical Functional Analysis and Optimization

Abstract:The nonsymmetric algebraic Riccati equation is proposed by using the tensor product. The existence of its minimal nonnegative solution is studied. The sufficient condition of the existence and the uniqueness of the minimal nonnegative solution is given by M-tensor as well. The solution can be obtained by the fast Fourier transform which save computational cost of computing the required solution. Some numerical experiments are performed.
Solving Multi-linear Systems with ℳ -Tensors

Weiyang Ding,Yimin Wei

DOI: https://doi.org/10.1007/s10915-015-0156-7

2016-01-01

Journal of Scientific Computing

Abstract:This paper is concerned with solving some structured multi-linear systems, especially focusing on the equations whose coefficient tensors are ℳ -tensors, or called ℳ -equations for short. We prove that a nonsingular ℳ -equation with a positive right-hand side always has a unique positive solution. Several iterative algorithms are proposed for solving multi-linear nonsingular ℳ -equations, generalizing the classical iterative methods and the Newton method for linear systems. Furthermore, we apply the ℳ -equations to some nonlinear differential equations and the inverse iteration for spectral radii of nonnegative tensors.
Solving system of nonlinear matrix equations over Hermitian positive definite matrices

Raziyeh Erfanifar,Khosro Sayevand,Masoud Hajarian

DOI: https://doi.org/10.1080/03081087.2022.2038058

2022-02-16

Linear and Multilinear Algebra

Abstract:In this article, we first introduce the necessary and sufficient conditions for the existence of the Hermitian positive definite solution group of a system of nonlinear matrix equations Then we propose an inversion-free iteration method to find the Hermitian positive definite solution group of the system of nonlinear matrix equations. Finally, the accuracy and effectiveness of the proposed method in compare to some existing algorithms are demonstrated by various numerical examples.

mathematics
A family of iterative methods to solve nonlinear problems with applications in fractional differential equations

Raziyeh Erfanifar,Masoud Hajarian,Khosro Sayevand

DOI: https://doi.org/10.1002/mma.9736

2023-10-20

Mathematical Methods in the Applied Sciences

Abstract:In this work, first, a family of fourth‐order methods is proposed to solve nonlinear equations. The methods satisfy the Kung‐Traub optimality conjecture. By developing the methods into memory methods, their efficiency indices are increased. Then, the methods are extended to the multi‐step methods for finding the solutions to systems of problems. The formula for the order of convergence of the multi‐step iterative methods is 2p , where p is the step number of the methods. It is clear that computing the Jacobian matrix derivative evaluation and its inversion are expensive; therefore, we compute them only once in every cycle of the methods. The important feature of these multi‐step methods is their high‐efficiency index. Numerical examples that confirm the theoretical results are performed. In applications, some nonlinear problems related to the numerical approximation of fractional differential equations (FDEs) are constructed and solved by the proposed methods.

mathematics, applied
Iterative Methods for Sparse Symmetric Multilinear Systems

Eisa Khosravi Dehdezi

DOI: https://doi.org/10.1007/s41980-024-00875-y

2024-05-08

Bulletin of the Iranian Mathematical Society

Abstract:In this research, we extend three attractive iterative methods—conjugate gradient, conjugate residual, and minimal residual—to solve large sparse symmetric multilinear system . We prove that the developed iterative methods converge under some appropriate conditions. As an application, we applied the proposed methods for solving the Klein–Gordon equation with Dirichlet boundary condition. Also, comparing these iterative methods to some new preconditioned splitting methods shows that, applying new methods for solving symmetric tensor equation , in which the coefficient tensor is an -tensor, are more efficient. Numerical results demonstrate that our methods are feasible and effective for solving this type of tensor equations. Finally, some concluding remarks are given.

mathematics
A tensor-based approach to solving linear systems involving Kronecker sum of matrices

Ahmad Y. Al-Dweik,Abdallah Sayyed-Ahmad

2024-10-05

Abstract:A tensor-based formula for solving the linear system involving Kronecker sum is proposed. It is shown that the linear system involving Kronecker sum of matrices is directly related to the matrix and tensor forms of Sylvester equation. The new tensor-based formula indicates that a Sylvester tensor equation has a unique solution if the sum of spectra of the matrices does not contain zero. As an application, we solve the discretized Poisson equation on a rectangular domain and Dirichlet boundary conditions. In 2d, we show that both the new formula and the fast Poisson solver based on diagonalization have the same cost $\mathcal {O}(n^{3/2})$. In 3d, the new formula has the cost $\mathcal {O}(n^{4/3})$ while cyclic reduction and successive over-relaxation methods have a complexity of $\mathcal {O}(n^{3/2})$.

General Mathematics
Solving a Class of Infinite-Dimensional Tensor Eigenvalue Problems by Translational Invariant Tensor Ring Approximations

Roel Van Beeumen,Lana Periša,Daniel Kressner,Chao Yang

2023-10-03

Abstract:We examine a method for solving an infinite-dimensional tensor eigenvalue problem $H x = \lambda x$, where the infinite-dimensional symmetric matrix $H$ exhibits a translational invariant structure. We provide a formulation of this type of problem from a numerical linear algebra point of view and describe how a power method applied to $e^{-Ht}$ is used to obtain an approximation to the desired eigenvector. This infinite-dimensional eigenvector is represented in a compact way by a translational invariant infinite Tensor Ring (iTR). Low rank approximation is used to keep the cost of subsequent power iterations bounded while preserving the iTR structure of the approximate eigenvector. We show how the averaged Rayleigh quotient of an iTR eigenvector approximation can be efficiently computed and introduce a projected residual to monitor its convergence. In the numerical examples, we illustrate that the norm of this projected iTR residual can also be used to automatically modify the time step $t$ to ensure accurate and rapid convergence of the power method.

Numerical Analysis
Solving Multi-linear Systems with M-Tensors.

Weiyang Ding,Yimin Wei

DOI: https://doi.org/10.1007/s10915-015-0156-7

2016-01-01

Abstract:This paper is concerned with solving some structured multi-linear systems, especially focusing on the equations whose coefficient tensors are M-tensors, or called M-equations for short. We prove that a nonsingular M-equation with a positive right-hand side always has a unique positive solution. Several iterative algorithms are proposed for solving multi-linear nonsingular M-equations, generalizing the classical iterative methods and the Newton method for linear systems. Furthermore, we apply theM-equations to some nonlinear differential equations and the inverse iteration for spectral radii of nonnegative tensors.
Weighted Moore-Penrose Inverses and Fundamental Theorem of Even-Order Tensors with Einstein Product

Jun Ji,Yimin Wei

DOI: https://doi.org/10.1007/s11464-017-0628-1

2017-01-01

Frontiers of Mathematics in China

Abstract:We treat even-order tensors with Einstein product as linear operators from tensor space to tensor space, define the null spaces and the ranges of tensors, and study their relationship. We extend the fundamental theorem of linear algebra for matrix spaces to tensor spaces. Using the new relationship, we characterize the least-squares (M) solutions to a multilinear system and establish the relationship between the minimum-norm (N) leastsquares (M) solution of a multilinear system and the weighted Moore-Penrose inverse of its coefficient tensor. We also investigate a class of even-order tensors induced by matrices and obtain some interesting properties.
Tensor Krylov subspace methods via the T-product for large Sylvester tensor equations

F. Bouyghf,M. El Guide,A. El Ichi

2024-05-15

Abstract:In the present paper, we introduce new tensor krylov subspace methods for solving large Sylvester tensor equations. The proposed method uses the well-known T-product for tensors and tensor subspaces. We introduce some new tensor products and the related algebraic properties. These new products will enable us to develop third-order the tensor FOM (tFOM), GMRES (tGMRES), tubal Block Arnoldi and the tensor tubal Block Arnoldi method to solve large Sylvester tensor equation. We give some properties related to these method and present some numerical experiments.

Numerical Analysis
Fast Fourier Solvers for the Tensor Product High-Order FEM for a Poisson Type Equation

A. A. Zlotnik,I. A. Zlotnik

DOI: https://doi.org/10.1134/s096554252002013x

2020-02-01

Computational Mathematics and Mathematical Physics

Abstract:Logarithmically optimal in theory and fast in practice, direct algorithms for implementing a tensor product finite element method (FEM) based on tensor products of 1D high-order FEM spaces on multi-dimensional rectangular parallelepipeds are proposed for solving the N-dimensional Poisson-type equation $$ - \Delta u + \alpha u = f$$ ($$N \geqslant 2$$) with Dirichlet boundary conditions. The algorithms are based on well-known Fourier approaches. The key new points are a detailed description of the eigenpairs of the 1D eigenvalue problems for the high-order FEM, as well as fast direct and inverse eigenvector expansion algorithms that simultaneously employ several versions of the fast Fourier transform. Results of numerical experiments in the 2D and 3D cases are presented. The algorithms can be used in numerous applications, in particular, to implement tensor product high-order finite element methods for various time-dependent partial differential equations, including the multidimensional heat, wave, and Schrödinger ones.

mathematics, applied,physics, mathematical
Preconditioned low-rank Riemannian optimization for linear systems with tensor product structure

Daniel Kressner,Michael Steinlechner,Bart Vandereycken

DOI: https://doi.org/10.48550/arXiv.1508.02988

2015-08-13

Abstract:The numerical solution of partial differential equations on high-dimensional domains gives rise to computationally challenging linear systems. When using standard discretization techniques, the size of the linear system grows exponentially with the number of dimensions, making the use of classic iterative solvers infeasible. During the last few years, low-rank tensor approaches have been developed that allow to mitigate this curse of dimensionality by exploiting the underlying structure of the linear operator. In this work, we focus on tensors represented in the Tucker and tensor train formats. We propose two preconditioned gradient methods on the corresponding low-rank tensor manifolds: A Riemannian version of the preconditioned Richardson method as well as an approximate Newton scheme based on the Riemannian Hessian. For the latter, considerable attention is given to the efficient solution of the resulting Newton equation. In numerical experiments, we compare the efficiency of our Riemannian algorithms with other established tensor-based approaches such as a truncated preconditioned Richardson method and the alternating linear scheme. The results show that our approximate Riemannian Newton scheme is significantly faster in cases when the application of the linear operator is expensive.

Numerical Analysis
A Flexible Power Method for Solving Infinite Dimensional Tensor Eigenvalue Problems

Roel Van Beeumen,Lana Periša,Daniel Kressner,Chao Yang

2021-01-01

Abstract:We examine a method for solving an infinite-dimensional tensor eigenvalue problem H x = λ x, where the infinite-dimensional symmetric matrix H exhibits a translational invariant structure. We provide a formulation of this type of problem from a numerical linear algebra point of view and describe how a power method applied to e^-Ht is used to obtain an approximation to the desired eigenvector. This infinite-dimensional eigenvector is represented in a compact way by a translational invariant infinite Tensor Ring (iTR). Low rank approximation is used to keep the cost of subsequent power iterations bounded while preserving the iTR structure of the approximate eigenvector. We show how the averaged Rayleigh quotient of an iTR eigenvector approximation can be efficiently computed and introduce a projected residual to monitor its convergence. In the numerical examples, we illustrate that the norm of this projected iTR residual can also be used to automatically modify the time step t to ensure accurate and rapid convergence of the power method.
On the Iterative Methods for the Solution of Three Types of Nonlinear Matrix Equations

Ivan G. Ivanov,Hongli Yang

DOI: https://doi.org/10.3390/math11214436

IF: 2.4

2023-10-27

Mathematics

Abstract:In this paper, we investigate the iterative methods for the solution of different types of nonlinear matrix equations. More specifically, we consider iterative methods for the minimal nonnegative solution of a set of Riccati equations, a nonnegative solution of a quadratic matrix equation, and the maximal positive definite solution of the equation X+A∗X−1A=Q. We study the recent iterative methods for computing the solution to the above specific type of equations and propose more effective modifications of these iterative methods. In addition, we make comments and comparisons of the existing methods and show the effectiveness of our methods by illustration examples.

mathematics
Solving Multi-linear Systems with $$\mathcal {M}$$m-Tensors

Weiyang Ding,Yimin Wei

DOI: https://doi.org/10.1007/s10915-015-0156-7

2016-01-01

Journal of Scientific Computing

Abstract:This paper is concerned with solving some structured multi-linear systems, especially focusing on the equations whose coefficient tensors are $\mathcal {M}$-tensors, or called $\mathcal {M}$-equations for short. We prove that a nonsingular $\mathcal {M}$-equation with a positive right-hand side always has a unique positive solution. Several iterative algorithms are proposed for solving multi-linear nonsingular $\mathcal {M}$-equations, generalizing the classical iterative methods and the Newton method for linear systems. Furthermore, we apply the $\mathcal {M}$-equations to some nonlinear differential equations and the inverse iteration for spectral radii of nonnegative tensors.

Several efficient iterative algorithms for solving nonlinear tensor equation with Einstein product

On sign function of tensors with Einstein product and its application in solving Yang–Baxter tensor equation

Solutions of linear and non-linear partial differential equations by means of tensor product theory of Banach space

Computing Symmetric Positive Definite Solutions of Three Types of Nonlinear Matrix Equations

Numerical solution to a linear equation with tensor product structure.

Developing iterative algorithms to solve Sylvester tensor equations

Nonsymmetric Algebraic Riccati Equations under the Tensor Product

Solving Multi-linear Systems with ℳ -Tensors

Solving system of nonlinear matrix equations over Hermitian positive definite matrices

A family of iterative methods to solve nonlinear problems with applications in fractional differential equations

Iterative Methods for Sparse Symmetric Multilinear Systems

A tensor-based approach to solving linear systems involving Kronecker sum of matrices

Solving a Class of Infinite-Dimensional Tensor Eigenvalue Problems by Translational Invariant Tensor Ring Approximations

Solving Multi-linear Systems with M-Tensors.

Weighted Moore-Penrose Inverses and Fundamental Theorem of Even-Order Tensors with Einstein Product

Tensor Krylov subspace methods via the T-product for large Sylvester tensor equations

Fast Fourier Solvers for the Tensor Product High-Order FEM for a Poisson Type Equation

Preconditioned low-rank Riemannian optimization for linear systems with tensor product structure

A Flexible Power Method for Solving Infinite Dimensional Tensor Eigenvalue Problems

On the Iterative Methods for the Solution of Three Types of Nonlinear Matrix Equations

Solving Multi-linear Systems with $$\mathcal {M}$$m-Tensors