Abstract:The optimization of Fast Fourier Transfer (FFT) problems that can fit into GPU memory has been studied extensively. Such on-card FFT libraries like CUFFT can generally achieve much better performance than their counterparts on a CPU, as the data transfer between CPU and GPU is usually not counted in their performance. This high performance, however, is limited by the GPU memory size. When the FFT problem size increases, the data transfer between system and GPU memory can comprise a substantial part of the overall execution time. Therefore, optimizations for FFT problems that outgrow the GPU memory can not bypass the tuning of data transfer between CPU and GPU. However, no prior study has attacked this problem. This paper is the first effort of using GPUs to efficiently compute large FFTs in the CPU memory of a single compute node. In this paper, the performance of the PCI bus during the transfer of a batch of FFT subarrays is studied and a blocked buffer algorithm is proposed to improve the effective bandwidth. More importantly, several FFT decomposition algorithms are proposed so as to increase the data locality, further improve the PCI bus efficiency and balance computation between kernels. By integrating the above two methods, we demonstrate an out-of-card FFT optimization strategy and develop an FFT library that efficiently computes large 1D, 2D and 3D FFTs that can not fit into the GPU's memory. On three of the latest GPUs, our large FFT library achieves much better double precision performance than two of the most efficient CPU based libraries, FFTW and Intel MKL. On average, our large FFTs on a single GeForce GTX480 are 46% faster than FFTW and 57% faster than MKL with multiple threads running on a four-core Intel i7 CPU. The speedup on a Tesla C2070 is 1.93x and 2.11x over FFTW and MKL. A peak performance of 21GFLOPS is achieved for a 2D FFT of size 2048x65536 on C2070 with double precision.

Efficient and Flexible Implementation of FFT Application for CGRA Processor

Efficient FFT Implementation on a CGRA

Acceleration of FFT Algorithm Based on Reconfigurable Computing Architecture

HW/SW approaches to accelerate GRAPES in an FU array

Mixed-granularity Parallel Coarse-Grained Reconfigurable Architecture

An Improved Fft Architecture Optimized for Reconfigurable Application Specified Processor

An Area- and Energy-Efficient Hybrid Architecture for Floating-Point FFT Computations.

A GPU Based Memory Optimized Parallel Method For FFT Implementation

Combining Memory Partitioning and Subtask Generation for Parallel Data Access on CGRAs

Row-based Configuration Mechanism for a 2-D Processing Element Array in Coarse-Grained Reconfigurable Architecture

An Efficient Radix-2 Fast Fourier Transform Processor with Ganged Butterfly Engines on Field Programmable Gate Arrays.

Using GPUs to compute large out-of-card FFTs

A Coarse-Grained Reconfigurable Architecture for Compute-Intensive MapReduce Acceleration

Enhancing CGRA Efficiency Through Aligned Compute and Communication Provisioning

R-Blocks: an Energy-Efficient, Flexible, and Programmable CGRA

An Ultra-Long FFT Architecture Implemented in a Reconfigurable Application Specified Processor

A Reconfigurable Floating-Point Fft Architecture

A CGRA Front-end Compiler Enabling Extraction of General Control and Dedicated Operators

An Architecture-Agnostic Dataflow Mapping Framework on CGRA

FastCGRA: A Modeling, Evaluation, and Exploration Platform for Large-Scale Coarse-Grained Reconfigurable Arrays

Flip: Data-Centric Edge CGRA Accelerator