Abstract:Fast Fourier transform (FFT) is widely used in computing applications in large-scale parallel programs, and data communication is the main performance bottleneck of FFT and seriously affects its parallel efficiency. To tackle this problem, we propose a new large-scale FFT framework, MFFT, which optimizes parallel FFT with a new mixed-precision optimization technique, adopting the “high precision computation, low precision communication” strategy. To enable “low precision communication”, we propose a shared-exponent floating-point number compression technique, which reduces the volume of data communication, while maintaining higher accuracy. In addition, we apply a two-phase normalization technique to further reduce the round-off error. Based on the mixed-precision MFFT framework, we apply several optimization techniques to improve the performance, such as streaming of GPU kernels, MPI message combination, kernel optimization, and memory optimization. We evaluate MFFT on a system with 4096 GPUs. The results show that shared-exponent MFFT is 1.23x faster than that of double-precision MFFT on average, and double-precision MFFT achieves performance 3.53x and 9.48x on average higher than open source library 2Decomp&FFT (CPU-based version) and heFFTe (AMD GPU-based version), respectively. The parallel efficiency of double-precision MFFT increased from \(53.2\% \) to \(78.1\% \) compared with 2Decomp&FFT, and shared-exponent MFFT further increases the parallel efficiency to \(83.8\% \) .

Implementation and Evaluation of Parallel Fft on Engineering and Scientific Computation Accelerator (esca) Architecture

The Parallel Algorithm Implementation of Matrix Multiplication Based on ESCA

Acceleration of FFT Algorithm Based on Reconfigurable Computing Architecture

Programming FFT on DSM Multiprocessors

Efficient and Flexible Implementation of FFT Application for CGRA Processor

Heterogeneous multi-core coprocessor ESCA and JPEG compression encoding algorithm

Parallel Solution of FFT on FPGA-Based NUMA Multiprocessor System on Chip

Parallel FFT Implementation Based on Multi-Core DSPs

Design and Implementation of Hyper-Speed FFT Processor

A High Performance Implementation of Non-Power-of-Two FFT with EPUMA Platform

A Case Study of Accelerating Apache Spark with FPGA.

A Multi-FPGA High Performance Computing System for 3D FFT-based Numerical Simulations

An Ultra-high-speed Fully-parallel Fast Fourier Transform Design

MFFT: A GPU Accelerated Highly Efficient Mixed-precision Large-scale FFT Framework

HW/SW approaches to accelerate GRAPES in an FU array

High Throughput Dual-mode Reconfigurable Floating-point FFT Processor

NOVEL HIGH-SPEED FPGA-BASED FFT PROCESSOR

Efficient Ab-Initio Molecular Dynamic Simulations by Offloading Fast Fourier Transformations to FPGAs

An Area- and Energy-Efficient Hybrid Architecture for Floating-Point FFT Computations.

Implementation and optimization of <scp>GPU‐based</scp> parallel <scp>one‐step</scp> leapfrog <scp>ADI‐FDTD</scp> for far‐field scattering problems

A Reconfigurable Floating-Point Fft Architecture