Cross-dataset Model Training for Hyperspectral Image Classification Using Self-supervised Learning

Jing Bai,Zichen Zhou,Zheng Chen,Zhu Xiao,Erlong Wei,Yihong Wen,Licheng Jiao
DOI: https://doi.org/10.1109/tgrs.2024.3493969
IF: 8.2
2024-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:With the development of deep learning and the increase in the amount of data, general artificial intelligence models have become a popular research area nowadays. When facing a new application scenario, a pre-training general model can often show better performance than models trained with new data on its own. However, because of the specificity of the differences in hyperspectral image data bands, the current hyperspectral image classification field has not proposed a better general model training solution, and it is difficult to utilize the information of the existing hyperspectral datasets for model training in the face of a new scenario. In order to solve this problem, this paper proposes a generalized hyperspectral classification model training method, which effectively completes the training of hyperspectral classification models across datasets by adaptive channel module and mask self-supervised pre-training method, and can pre-train and fine-tune hyperspectral classification models using multiple datasets. The adaptive channel module is able to solve the band difference problem of using hyperspectral datasets across datasets, and the masked self-supervised learning method solves the label difference and labeling difficulties of training models cross dataset. Experimental results on multiple datasets show that the method proposed in this paper can effectively use a large amount of data to complete the pre-training of hyperspectral classification models, and the fine-tuning results on downstream datasets have certain advantages relative to current advanced deep learning methods.
What problem does this paper attempt to address?