Abstract:We present a notion of bilinear stability, which is to numerical stability what bilinear complexity is to time complexity. In bilinear complexity, an algorithm for evaluating a bilinear operator $\beta : \mathbb{U} \times \mathbb{V} \to \mathbb{W}$ is a decomposition $\beta = \varphi_1 \otimes \psi_1 \otimes w_1 + \dots + \varphi_r \otimes \psi_r \otimes w_r $; the number of terms $r$ captures the speed of the algorithm; and its smallest possible value, i.e., the tensor rank of $\beta$, quantifies the speed of a fastest algorithm. Bilinear stability introduces norms to the mix: The growth factor of the algorithm $\lVert \varphi_1 \rVert_* \lVert \psi_1 \rVert_* \lVert w_1 \rVert + \dots + \lVert \varphi_r \rVert_* \lVert \psi_r \rVert_* \lVert w_r \rVert$ captures the accuracy of the algorithm; and its smallest possible value, i.e., the tensor nuclear norm of $\beta$, quantifies the accuracy of a stablest algorithm. To substantiate this notion, we establish a bound for the forward error in terms of the growth factor and present numerical evidence comparing various fast algorithms for matrix and complex multiplications, showing that larger growth factors correlate with less accurate results. Compared to similar studies of numerical stability, bilinear stability is more general, applying to any bilinear operators and not just matrix or complex multiplications; is more simplistic, bounding forward error in terms of a single (growth) factor; and is truly tensorial like bilinear complexity, invariant under any orthogonal change of coordinates. As an aside, we study a new algorithm for computing complex multiplication in terms of real, much like Gauss's, but is optimally fast and stable in that it attains both tensor rank and nuclear norm.

Bilinear systems -- A new link to $\mathcal H_2$-norms, relations to stochastic systems and further properties

H-2 Model Order Reduction Based on Gramians of Discrete-Time Bilinear Systems

Bilateral Bounds for Norms of Solutions and Boundedness/Stability and Instability of Some Nonlinear Systems with Delays and Variable Coefficients

Dyadic-probabilistic methods in bilinear analysis

Model order reduction of linear and bilinear systems via low-rank Gramian approximation

Complexity reduction of large-scale stochastic systems using linear quadratic Gaussian balancing

H-2 Model Order Reduction For Bilinear Systems Based On The Cross Gramian

Numerical stability and tensor nuclear norm

$$\Mathscr{h}_{2}$$ Model Order Reduction for Bilinear Systems Based on the Cross Gramian.

Control of bilinear systems using gain-scheduling: Stability and performance guarantees

An Online Learning Algorithm for Bilinear Models

Multipoint Volterra Series Interpolation and H2 Optimal Model Reduction of Bilinear Systems

A Trust-Region Method for H2 Model Reduction of Bilinear Systems on the Stiefel Manifold

H2 Order-Reduction for Bilinear Systems Based on Grassmann Manifold

An Approach to H2, Ω Model Reduction on Finite Interval for Bilinear Systems

Structural Controllability of Bilinear Systems on $\mathbb{SE(n)}$

Linear systems, spectral curves and determinants

Structure-preserving model order reduction for K-power bilinear systems via Laguerre functions

Error bounds for model reduction of feedback-controlled linear stochastic dynamics on Hilbert spaces

Parametrized systems of generalized polynomial inequalitites via linear algebra and convex geometry

Hyperbolic systems with non-diagonalisable principal part and variable multiplicities, III: singular coefficients