A Novel Fast Approach for Convolutional Networks with Small Filters Based on GPU

Wenbin Jiang,Yiming Chen,Hai Jin,Bin Luo,Ye Chi
DOI: https://doi.org/10.1109/HPCC-CSS-ICESS.2015.218
2015-01-01
Abstract:Recently, convolutional networks have achieved great successes in the field of computer vision. In order to improve the efficiency of convolutional networks, large amount of solutions focusing on training algorithms and parallelism strategies have been proposed. In this paper, a novel algorithm based on look-up table is proposed to speed up convolutional networks with small filters by applying GPU. By transforming multiplication operations in the convolution computation to some table-based summation operations, the overhead of convolution computation can be reduced largely. The process of creating table and looking up table is very appropriate for parallelization on GPU. Experiment results show that the proposed approaches can improve the speed of convolution computation by 20%-30%, compared with state-of-the-art existing works.
What problem does this paper attempt to address?