CS-Net: Deep Multibranch Network Considering Scene Features for Sharpness Assessment of Remote Sensing Images
Liangyu Chen,Jun Pan,Jin Yang,Mi Wang
DOI: https://doi.org/10.1109/tgrs.2024.3377629
IF: 8.2
2024-04-03
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Recently, many new results of sharpness assessment for digital images have been achieved, which help to select valuable images from massive images with ragged quality. However, remote sensing images encompass a wide range of scenes with diverse characteristics, and their acquisition is often influenced by blurs and noises. Many commonly used sharpness assessment methods based on uniform metrics face challenges in ensuring both subjective and objective impartiality when applied to remote sensing images. Therefore, a novel method for assessing the sharpness of remote sensing images based on a deep multibranch network considering scene features is proposed. In the method, a multitask module (MTM), comprising scene classification and sharpness assessment tasks, is proposed to comprehensively consider the potential impact of diverse scene characteristics on the assessment of sharpness. The accuracy of sharpness assessment is improved by sharing features that reflect the correlation between the scene and sharpness. To overcome the issue of imbalanced task predictions during the joint training of multiple tasks, a total loss function using gradient balance strategy is designed. In addition, the improved attention module (IAM) and the feature fusion module (FFM) are used to better utilize feature information at different scales. Experimental results obtained from datasets demonstrated that the proposed method can outperform the existing comparable methods and achieve satisfactory results, proving its feasibility and effectiveness.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics