Self-Supervised Learning with Learnable Sparse Contrastive Sampling for Hyperspectral Image Classification

Miaomiao Liang,Jian Dong,Lingjuan Yu,Xiangchun Yu,Zhe Meng,Licheng Jiao
DOI: https://doi.org/10.1109/tgrs.2023.3331888
IF: 8.2
2023-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Contrastive learning (CL) with learnable examples performs outstandingly in data representation. However, when dealing with hard samples, instance-level alignment with excessive uniformity may descend into trivial clusters, especially when confronted with interclass similarity and intraclass diversity in hyperspectral images (HSIs). To solve this problem, we regard prototypical CL as tracing the potential probability density distribution. Then, a novel pretraining method, learnable sparse contrastive sampling (LSCoSa), is proposed for discriminative representation learning, containing sparse positive sampling and multiple positives learning. Specifically, on the basis of cooperative–adversarial CL, we first exert a Kullback–Leibler (KL) divergence regularizer on the average activation probability of the prototypes, suppressing fake density prototypes for sparse positive sampling. Furthermore, we propose multiple positives learning, in which the top- $k$ potential positives are retrieved and dynamically weighted for contrastive supervision, to avoid trivial clusters and cover satisfying semantic variations. Comprehensive experiments on three HSI benchmark datasets demonstrate that LSCoSa achieves significant advantages over other HSI classification (HSIC) methods. The code is available at https://github.com/sakurashine/LSCoSa .
What problem does this paper attempt to address?