Abstract:We observe a disconnect between the developers and the end users of linear algebra libraries. On the one hand, the numerical linear algebra and the high-performance communities invest significant effort in the development and optimization of highly sophisticated numerical kernels and libraries, aiming at the maximum exploitation of both the properties of the input matrices, and the architectural features of the target computing platform. On the other hand, end users are progressively less likely to go through the error-prone and time consuming process of directly using said libraries by writing their code in C or Fortran; instead, languages and libraries such as Matlab, Julia, Eigen and Armadillo, which offer a higher level of abstraction, are becoming more and more popular. Users are given the opportunity to code matrix computations with a syntax that closely resembles the mathematical description; it is then a compiler or an interpreter that internally maps the input program to lower level kernels, as provided by libraries such as BLAS and LAPACK. Unfortunately, our experience suggests that in terms of performance, this translation is typically vastly suboptimal. In this paper, we first introduce the Linear Algebra Mapping Problem, and then investigate how effectively a benchmark of test problems is solved by popular high-level programming languages. Specifically, we consider Matlab, Octave, Julia, R, Armadillo (C++), Eigen (C++), and NumPy (Python); the benchmark is meant to test both standard compiler optimizations such as common subexpression elimination and loop-invariant code motion, as well as linear algebra specific optimizations such as optimal parenthesization of a matrix product and kernel selection for matrices with properties. The aim of this study is to give concrete guidelines for the development of languages and libraries that support linear algebra computations.

Using Method of Linear Map to Matrix Theory and Operation

Infinite Matrix Method, ($\boldsymbol~{op}$) Type Space, Invariance and Demi-Linear Analysis

Hopf Algebra Approaches To Nonlinear Algebraic Equations

CONTINUITY AND BOUNDEDNESS FOR OPERATOR-VALUED MATRIX MAPPINGS

The Linear Algebra Mapping Problem. Current state of linear algebra languages and libraries

The Matrix of Linear Mappings

A Linear Algebra approach to monomiality and operational methods

An Elementary Problem and Techniques in Linear Algebra

Some new facts about linear maps that preserve the orthogonal group

Discussing on Commutative Problem of Linear Transform

Exposedness of elementary positive maps between matrix algebras

Relativistic equilibrium velocity distribution, nuclear fusion reaction rate and the solar neutrino problem

Kantorovich'S Theorems for Newton'S Method for Mappings and Optimization Problems on Lie Groups

On linear algebra of r-Hankel and r-Toeplitz matrices with geometric sequence

Linear maps on matrices preserving parallel pairs

On the Teaching of the Linear Algebra for Engineering Students

On Equivalence and Linearization of Operator Matrix Functions with Unbounded Entries

On Linear Representation, Complexity and Inversion of maps over finite fields

Analysis of the properties of matrix rank and the relationship between matrix rank and matrix operations

Cross-positive linear maps, positive polynomials and sums of squares

Linear preservers on upper triangular operator matrix algebras