ABCP: Automatic Block-wise and Channel-wise Network Pruning via Joint Search
Jiaqi Li,Haoran Li,Yaran Chen,Zixiang Ding,Nannan Li,Mingjun Ma,Zicheng Duan,Dongbin Zhao,Dongbing Zhao
DOI: https://doi.org/10.1109/tcds.2022.3230858
IF: 4.546
2022-01-01
IEEE Transactions on Cognitive and Developmental Systems
Abstract:Currently, an increasing number of model pruning methods are proposed to resolve the contradictions between the computer powers required by the deep learning models and the resource-constrained devices. However, for simple tasks like robotic detection, most of the traditional rule-based network pruning methods cannot reach a sufficient compression ratio with low accuracy loss and are time consuming as well as laborious. In this article, we propose automatic blockwise and channelwise network pruning (ABCP) to jointly search the blockwise and channelwise pruning action for robotic detection by deep reinforcement learning. A joint sample algorithm is proposed to simultaneously generate the pruning choice of each residual block and the channel pruning ratio of each convolutional layer from the discrete and continuous search space, respectively. The best pruning action taking both the accuracy and the complexity of the model into account is obtained finally. Compared with the traditional rule-based pruning method, this pipeline saves human labor and achieves a higher compression ratio with lower accuracy loss. Tested on the mobile robot detection data set, the pruned YOLOv3 model saves 99.5% floating-point operations, reduces 99.5% parameters, and achieves $\boldsymbol {37.3\times }$ speed up with only 2.8% mean of average precision (mAP) loss. On the sim2real detection data set for robotic detection task, the pruned YOLOv3 model achieves 9.6% better mAP than the baseline model, showing better robustness performance.
robotics,computer science, artificial intelligence,neurosciences