Abstract:Utilizing remote sensing to monitor and obtain the land use information is crucial for sustainable development goals (SDGs), including sustainable agriculture, urbanization processes, land reclamation, etc. The development of remote sensing big data and deep learning has greatly promoted the use of multi-source images to understand land use. However, in practical applications, missing data often occurs due to high cost and environmental limitation. Therefore, we propose a framework which can towards robust classification of multi-view remote sensing images with partial data availability. First, we construct a student model and teacher model mutual learning framework. In particular, we promote the consistency of student model and teacher model which enhances robustness under missing view and further improves performance under complete views. Second, we propose a parameter-free channel & spatial attention (PFCSA) module embedded in the image encoders, which allows the architecture with three encoders to balance performance and lightweight. Further, the cross-view attention fusion (CAF) module is designed to enhance the fusion of multi-view images. The experiments based on global data show that the proposed method can utilize multi-views more effectively than common fusion strategies. Our method also ensures robustness against missing view compared to other methods. And we reveal the effectiveness of each proposed strategies. In addition, the contribution of different views and the mechanism of the model under missing view are analyzed. The proposed method in this study can be used to generate land use and its derived geographic information products on a global scale (including different natural and development regions), and further serve the realization of global SDGs. The code will be publicly available at https://github.com/mfzhao1998/multi_view_incomplete_learning .

MMI-ML: Maximize Mutual Information Between Different Views for Few-Shot Remote Sensing Image Classification

Few-shot learning for remote sensing image retrieval with maml

Few-Shot Remote Sensing Image Scene Classification Based on Metric Learning and Local Descriptors

TDNet: A Novel Transductive Learning Framework with Conditional Metric Embedding for Few-shot Remote Sensing Image Scene Classification

Multi‐View Self‐Supervised Auxiliary Task for Few‐Shot Remote Sensing Classification

Local Mutual Metric Network for Few-Shot Image Classification

Exploring Hard Samples in Multiview for Few-Shot Remote Sensing Scene Classification

Improving Deep Learning on Point Cloud by Maximizing Mutual Information Across Layers

ICSFF: Information Constraint on Self-Supervised Feature Fusion for Few-Shot Remote Sensing Image Classification

Image classification with multi-view multi-instance metric learning

Multi-scale fusion for few-shot remote sensing image classification

Binocular Mutual Learning for Improving Few-shot Classification

MKN: Metakernel Networks for Few Shot Remote Sensing Scene Classification

Few-Shot Object Detection With Multilevel Information Interaction for Optical Remote Sensing Images

Learning transferable cross-modality representations for few-shot hyperspectral and LiDAR collaborative classification

Multimodal variational contrastive learning for few-shot classification

SCL-MLNet: Boosting Few-Shot Remote Sensing Scene Classification via Self-Supervised Contrastive Learning

High-Order Distance-Based Multiview Stochastic Learning in Image Classification

Towards robust classification of multi-view remote sensing images with partial data availability

MM-Point: Multi-View Information-Enhanced Multi-Modal Self-Supervised 3D Point Cloud Understanding

Simplified Multi-head Mechanism for Few-Shot Remote Sensing Image Classification