Abstract:Convolution computation is a common operation in deep neural networks (DNNs) and is often responsible for performance bottlenecks during training and inferencing. Existing approaches for accelerating convolution operations aim to reduce computational complexity. However, these strategies often increase the memory footprint with extra memory accesses, thereby leaving much room for performance improvement. This paper presents a novel approach to optimize memory access for convolution operations, specifically targeting GPU execution. Our approach leverages two optimization techniques to reduce the number of memory operations for convolution operations performed on the width and height dimensions. For convolution computations on the width dimension, we exploit shuffle instructions to exchange the overlapped columns of the input for reducing the number of memory transactions. For convolution operations on the height dimension, we multiply each overlapped row of the input with multiple rows of a filter to compute multiple output elements to improve the data locality of row elements. We apply our approach to 2D and multi-channel 2D convolutions on an NVIDIA 2080Ti GPU. For 2D convolution, our approach delivers over faster performance than the state-of-the-art image processing libraries. For multi-channel 2D convolutions, we obtain up to speedups over the quickest algorithm of cuDNN. We apply our approach to 2D and multi-channel 2D convolutions on an NVIDIA 2080Ti GPU. For 2D convolution, our approach delivers over 2× faster performance than the state-of-the-art image processing libraries. For multi-channel 2D convolutions, we obtain up to 1.3× speedups over the quickest algorithm of cuDNN.

A Novel GPU-Based Efficient Approach for Convolutional Neural Networks with Small Filters

A Novel Fast Approach for Convolutional Networks with Small Filters Based on GPU

Optical Convolution Based Computational Method for Low-Power Image Processing

A GPU-based high-performance optimization method of sparse convolutional neural networks

Efficient Convolutional Neural Networks Utilizing Fine-Grained Fast Fourier Transforms

Performance Analysis of Different Convolution Algorithms in GPU Environment

High Performance Implementation of 3D Convolutional Neural Networks on a GPU

TabConv: Low-Computation CNN Inference via Table Lookups

Accelerating convolutional neural network by exploiting sparsity on GPUs

Performance Analysis of GPU-Based Convolutional Neural Networks

Enabling Efficient Fast Convolution Algorithms on GPUs Via MegaKernels

A tile-fusion method for accelerating Winograd convolutions

Optimizing GPU Memory Transactions for Convolution Operations

Accelerating CNNs Using Optimized Scheduling Strategy.

Convolution Without Multiplication: A General Speed Up Strategy for CNNs

Computational optimization of convolutional neural networks using separated filters architecture

Accelerating Large Kernel Convolutions with Nested Winograd Transformation

Accelerating Image Convolution Filtering Algorithms on Integrated CPU–GPU Architectures

Efficient and Accurate Approximations of Nonlinear Convolutional Networks

Improving Efficiency in Convolutional Neural Network with Multilinear Filters

Accelerating Large Kernel Convolutions with Nested Winograd Transformation.pdf