Abstract:The concept presented in this paper is based on previous dynamical methods to realize a time-varying matrix inversion. It is essentially a set of coupled ordinary differential equations (ODEs) which does indeed constitute a recurrent neural network (RNN) model. The coupled ODEs constitute a universal modeling framework for realizing a matrix inversion provided the matrix is invertible. The proposed model does converge to the inverted matrix if the matrix is invertible, otherwise it converges to an approximated inverse. Although various methods exist to solve a matrix inversion in various areas of science and engineering, most of them do assume that either the time-varying matrix inversion is free of noise or they involve a denoising module before starting the matrix inversion computation. However, in the practice, the noise presence issue is a very serious problem. Also, the denoising process is computationally expensive and can lead to a violation of the real-time property of the system. Hence, the search for a new 'matrix inversion' solving method inherently integrating noise-cancelling is highly demanded. In this paper, a new combined/extended method for time-varying matrix inversion is proposed and investigated. The proposed method is extending both the gradient neural network (GNN) and the Zhang neural network (ZNN) concepts. Our new model has proven that it has exponential stability according to Lyapunov theory. Furthermore, when compared to the other previous related methods (namely GNN, ZNN, Chen neural network, and integration-enhanced Zhang neural network or IEZNN) it has a much better theoretical convergence speed. To finish, all named models (the new one versus the old ones) are compared through practical examples and both their respective convergence and error rates are measured. It is shown/observed that the novel/proposed method has a better practical convergence rate when compared to the other models. Regarding the amount of noise, it is proven that there is a very good approximation of the matrix inverse even in the presence of noise.

Recurrent Neural Network for Computing Outer Inverse.

Neural Network Approach to Computing Outer Inverses Based on the Full Rank Representation

Recurrent Neural Network for Computing the Drazin Inverse.

Recurrent Neural Networks For Computing Weighted Moore-Penrose Inverse

Recurrent Neural Network Approach Based On The Integral Representation Of The Drazin Inverse

Recurrent neural networks for computing weighted Moore-Penrose inverse1This project is supported by the National Nature Science Foundation of China, Doctoral Point Foundation of China and Youth Science Foundation of Universities in Shanghai of China.1

A Novel Recurrent Neural Network-Based Ultra-Fast, Robust, and Scalable Solver for Inverting a "Time-Varying Matrix"

Complex ZFs for Computing Time-Varying Complex Outer Inverses.

A Zeroing Neural Network Approach for Calculating Time-Varying G-Outer Inverse of Arbitrary Matrix

From Zhang Neural Network to Newton Iteration for Matrix Inversion

Big in Japan: Regularizing networks for solving inverse problems

Generalized Inversion of Nonlinear Operators

The Neural Network Approach to Inverse Problems in Differential Equations

A Compound Gaussian Least Squares Algorithm and Unrolled Network for Linear Inverse Problems

Invertible residual networks in the context of regularization theory for linear inverse problems

Noise-tolerant neural algorithm for online solving time-varying full-rank matrix Moore–Penrose inverse problems: A control-theoretic approach

An Adaptive Gradient Neural Network to Solve Dynamic Linear Matrix Equations

Neumann Networks for Inverse Problems in Imaging

A Novel Iterative Method for Computing Generalized Inverse

Invertible ResNets for Inverse Imaging Problems: Competitive Performance with Provable Regularization Properties