WRGPruner: A new model pruning solution for tiny salient object detection
Fengwei Jia,Xuan Wang,Jian Guan,Huale Li,Chen Qiu,Shuhan Qi
DOI: https://doi.org/10.1016/j.imavis.2021.104143
IF: 3.86
2021-05-01
Image and Vision Computing
Abstract:<p>The model pruning is one of the predominant model compression tasks to decrease the demands in computing power and memory footprint. However, most existing pruning methods have overly broad application areas, which defects in a sub-optimal solution specifically to solve certain specified difficult problems in the tasks of salient object detection. In this paper, we propose a novel solution, dubbed as <strong>WRGPruner</strong>, based on the concept of salient energy level (SEL) for tiny salient object detection. The concept of SEL defines the level of assessing the distinguishing ability of parameters in the trained model between background and salient objects. To exploit the SEL, the WRGPruner is proposed, which considers three factors for model compression including the <strong>weight</strong> in the filter, the mathematical <strong>rank</strong> of the feature map matrix, and the <strong>gradient</strong> in the backward propagation. We mathematically prove the effectiveness of the WRGPruner for tiny salient objects. Besides, a tiny salient object dataset (TSOD) is constructed for evaluation. Extensive experiments show that WRGPruner reduces 60% of parameters with slight enhancement in terms of six accuracy metrics for VGG16 on TSOD. This demonstrates that the SEL is suitable for measure parameters and the effectiveness of WRGPruner.</p>
computer science, artificial intelligence, theory & methods,engineering, electrical & electronic, software engineering,optics