Abstract:We observe a disconnect between the developers and the end users of linear algebra libraries. On the one hand, the numerical linear algebra and the high-performance communities invest significant effort in the development and optimization of highly sophisticated numerical kernels and libraries, aiming at the maximum exploitation of both the properties of the input matrices, and the architectural features of the target computing platform. On the other hand, end users are progressively less likely to go through the error-prone and time consuming process of directly using said libraries by writing their code in C or Fortran; instead, languages and libraries such as Matlab, Julia, Eigen and Armadillo, which offer a higher level of abstraction, are becoming more and more popular. Users are given the opportunity to code matrix computations with a syntax that closely resembles the mathematical description; it is then a compiler or an interpreter that internally maps the input program to lower level kernels, as provided by libraries such as BLAS and LAPACK. Unfortunately, our experience suggests that in terms of performance, this translation is typically vastly suboptimal. In this paper, we first introduce the Linear Algebra Mapping Problem, and then investigate how effectively a benchmark of test problems is solved by popular high-level programming languages. Specifically, we consider Matlab, Octave, Julia, R, Armadillo (C++), Eigen (C++), and NumPy (Python); the benchmark is meant to test both standard compiler optimizations such as common subexpression elimination and loop-invariant code motion, as well as linear algebra specific optimizations such as optimal parenthesization of a matrix product and kernel selection for matrices with properties. The aim of this study is to give concrete guidelines for the development of languages and libraries that support linear algebra computations.

A Review of Matrix Algebra for Power and Energy Applications

Power Grid Analysis and Optimization Using Algebraic Multigrid

A Free and Open Source Toolbox Based on Mathematica for Power System Analysis

An improved AMG-based method for fast power grid analysis

Hypermatrix Representation of Unbalanced Power Distribution Systems

Towards sparse matrix operations: graph database approach for power grid computation

PowerModels.jl: An Open-Source Framework for Exploring Power Flow Formulations

An efficient open-source implementation to compute the Jacobian matrix for the Newton-Raphson power flow algorithm

A literature survey of matrix methods for data science

Index Matrices—Based Software Implementation of Power Electronic Circuit Design

The Linear Algebra Mapping Problem. Current state of linear algebra languages and libraries

A gentle introduction to matrix calculus

The power of block-encoded matrix powers: improved regression techniques via faster Hamiltonian simulation

Evaluating matrix power series with the Cayley-Hamilton theorem

Sneak Preview: PowerDynamics.jl -= An Open-Source library for analyzing dynamic stability in power grids with high shares of renewable energy

Application for the Stability Analysis of the Power System Based on MatrixVB

On the Implementation of the Fixed Point Iteration Current Injection Method to Solve Four-Wire Unbalanced Power Flow in PowerModelsDistribution.jl

Computer algebra in Julia

Effective Parallelism for Equation and Jacobian Evaluation in Power Flow Calculation

Theoretical studies of active power/angle sub-matrix in power flow Jacobian for power system analysis

Geometric Algebra Power Theory (GAPoT): Revisiting Apparent Power under Non-Sinusoidal Conditions