Abstract:Data movement is the dominating factor affecting performance and energy in modern computing systems. Consequently, many algorithms have been developed to minimize the number of I/O operations for common computing patterns. Matrix multiplication is no exception, and lower bounds have been proven and implemented both for shared and distributed memory systems. Reconfigurable hardware platforms are a lucrative target for I/O minimizing algorithms, as they offer full control of memory accesses to the programmer. While bounds developed in the context of fixed architectures still apply to these platforms, the spatially distributed nature of their computational and memory resources requires a decentralized approach to optimize algorithms for maximum hardware utilization. We present a model to optimize matrix multiplication for FPGA platforms, simultaneously targeting maximum performance and minimum off-chip data movement, within constraints set by the hardware. We map the model to a concrete architecture using a high-level synthesis tool, maintaining a high level of abstraction, allowing us to support arbitrary data types, and enables maintainability and portability across FPGA devices. Kernels generated from our architecture are shown to offer competitive performance in practice, scaling with both compute and memory resources. We offer our design as an open source project to encourage the open development of linear algebra and I/O minimizing algorithms on reconfigurable hardware platforms.

A Highly Customizable and Efficient Hardware Implementation for Parallel Matrix Inversion

Hardware Implementations with High Throughput, Low-Latency and Low-Area for Matrix Inversion

A High Performance Parallel VLSI Design of Matrix Inversion.

Design and Implementation of High Performance Matrix Inversion Based on Reconfigurable Processor

High-Throughput FPGA Implementation of Matrix Inversion for Control Systems

A Novel Fully Hardware-Implemented SVD Solver Based on Ultra-Parallel BCV Jacobi Algorithm

Design and Realization of Improved Matrix's Inverse Calculation in FPGA

VLSI Realization of Matrix Inversion

A Fast Parallel Matrix Inversion Algorithm Based on Heterogeneous Multicore Architectures

Flexible Communication Avoiding Matrix Multiplication on FPGA with High-Level Synthesis

Asynchronous Coarse-Grained Reconfigurable Computing Architecture for Matrix Inversion

A Scalable Hybrid Architecture for High Performance Data-Parallel Applications

AnScalable Matrix Computing Unit Architecture for FPGA,and SCUMO User Design Interface

Efficient Matrix Inversion Based on Vliw Architecture

Configurable sparse matrix - matrix multiplication accelerator on FPGA: A systematic design space exploration approach with quantization effects

Low-Latency FPGA Design and Implementation of Hermitian Matrix Inversion Based on Partitioned Systolic Array for Massive MIMO

Design of Field Programmable Gate Array Based Real-Time Double-Precision Floating-Point Matrix Multiplier

Optimizing Bit-Serial Matrix Multiplication for Reconfigurable Computing

A Fast Modular Inversion FPGA Implementation over GF(2(m)) Using Modified X(2n) Unit

Design of a Dynamically Reconfigurable Arithmetic Unit for Matrix Algorithms

An Accelerator Architecture of Changeable-Dimension Matrix Computing Method for SVM