Abstract:Fast Fourier transform (FFT) is widely used in computing applications in large-scale parallel programs, and data communication is the main performance bottleneck of FFT and seriously affects its parallel efficiency. To tackle this problem, we propose a new large-scale FFT framework, MFFT, which optimizes parallel FFT with a new mixed-precision optimization technique, adopting the “high precision computation, low precision communication” strategy. To enable “low precision communication”, we propose a shared-exponent floating-point number compression technique, which reduces the volume of data communication, while maintaining higher accuracy. In addition, we apply a two-phase normalization technique to further reduce the round-off error. Based on the mixed-precision MFFT framework, we apply several optimization techniques to improve the performance, such as streaming of GPU kernels, MPI message combination, kernel optimization, and memory optimization. We evaluate MFFT on a system with 4096 GPUs. The results show that shared-exponent MFFT is 1.23x faster than that of double-precision MFFT on average, and double-precision MFFT achieves performance 3.53x and 9.48x on average higher than open source library 2Decomp&FFT (CPU-based version) and heFFTe (AMD GPU-based version), respectively. The parallel efficiency of double-precision MFFT increased from \(53.2\% \) to \(78.1\% \) compared with 2Decomp&FFT, and shared-exponent MFFT further increases the parallel efficiency to \(83.8\% \) .

Algorithm and Implementation of a Large-Point FFT under the Master-Slave Parallel Multi-Processor Architecture

A Novel 3780-Point FFT Processor Scheme for the Time Domain Synchronous OFDM System

Implementation of Prime-Point DFTs with Programable Processors

Design and Implementation of High Speed Fixed-Point Fast Fourier Transform Processor

Design and Applications of a New Type of FFT Processor with High Efficiency

Design and Implementation of a Scaleable FFT Processor for Adaptive Broadband OFDM System

Parallel Solution of FFT on FPGA-Based NUMA Multiprocessor System on Chip

Design and Realization of Small Point FFT Processor Based on Twiddle Factor Classification

A VLSI Array Processing Oriented Fast Fourier Transform Algorithm and Hardware Implementation

Efficient implementation of 3780-point FFT on a 16-core processor

An Improved Fft Architecture Optimized for Reconfigurable Application Specified Processor

An Ultra-Long FFT Architecture Implemented in a Reconfigurable Application Specified Processor

Parallel Algorithm and Implementation of Adaptive Digital Multi-beam Forming Based on Multi-DSP

A High Performance Implementation of Non-Power-of-Two FFT with EPUMA Platform

FFT implementation with multi-operand floating point units

Reconfigurable Hyper-Parallel Fast Fourier Transform Processor Based on Bit-Serial Computing

1024-Point Pipeline FFT Processor with Pointer FIFOs Based on FPGA

Efficient Implementation of Real-Time PFFT Processor Based on FPGA

MFFT: A GPU Accelerated Highly Efficient Mixed-precision Large-scale FFT Framework

An Efficient Radix-2 Fast Fourier Transform Processor with Ganged Butterfly Engines on Field Programmable Gate Arrays.

A Pipelined Algorithm and Area-Efficient Architecture for Serial Real-Valued FFT