Energy-based CNNs Pruning for Remote Sensing Scene Classification
Yiheng Lu,Maoguo Gong,Zhuping Hu,Wei Zhao,Ziyu Guan,Mingyang Zhang
DOI: https://doi.org/10.1109/tgrs.2023.3277077
IF: 8.2
2023-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Convolutional neural networks (CNNs) have been adopted to classify the remote sensing scene image. However, the application of these complicated networks on the satellite platform is difficult because of the limited computation resources. Therefore, we propose an energy-based filter pruning framework (EFPF) to reduce the size of the original model. The energy can be obtained through the eigenvalues of each weight tensor by singular value decomposition (SVD). Specifically, we calculate the energy of each layer by the ratio of eigenvalues that are lower than a specified truncation parameter and then remove filters from the original layer in light of the degree of energy. The EFPF is reliable, because SVD techniques can capture the covariance among all filters from the original weight tensor, and therefore, the energy from the eigenvalues can reflect the redundancy of the filters (i.e., if the distribution of eigenvalues is sharp, then the energy among filters will be lower, and the redundancy will be higher). Surprisingly, the EFPF can reduce the floating point operations (FLOPs) and parameters, as well as improve the top1 accuracy obviously when the VGG-16 and ResNet-50 are adopted to classify the AID, NWPU45, PatternNet, and WHU19 datasets. Additionally, the EFPF can achieve similar pruning results when the original model is fully trained (converge) and undertrained (In-converge), which means that we can save the training computation resources for the original model.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics