Abstract:Content-based remote sensing (RS) image retrieval (CBRSIR) is a critical way to organize high-resolution RS (HRRS) images in the current big data era. The increasing volume of HRRS images from different satellites and sensors leads to more attention to the cross-source CSRSIR (CS-CBRSIR) problem. Due to the data drift, one crucial problem in CS-CBRSIR is the modality discrepancy. Most existing methods focus on finding a common feature space for various HRRS images to address this issue. In this space, their similarity relations can be measured directly to obtain the cross-source retrieval results straight. This way is feasible and reasonable, however, the specific information corresponding to HRRS images from different sources is always ignored, limiting retrieval performance. To overcome this limitation, we develop a new model for CS-CBRSIR in this paper named dual modality collaborative learning (DMCL). To fully explore the specific information from diverse HRRS images, DMCL first introduces ResNet50 as the feature extractor. Then, a common space mutual learning module is developed to map the specific features into a common space. Here, the modality discrepancy is reduced from the aspects of features and their distributions. Finally, to supplement the specific knowledge to the common features, we develop modality transformation and the dual-modality feature learning modules. Their function is to transmit the specific knowledge from different sources mutually and fuse the specific and common features adaptively. The comprehensive experiments are conducted on a public dataset. Compared with many existing methods, the behavior of our DMCL is stronger. These encouraging results for a public dataset indicate that the proposed DMCL is useful in CS-CBRSIR tasks.

Cross-Domain Collaborative Learning in Social Multimedia

Cross-Domain Collaborative Learning Via Discriminative Nonparametric Bayesian Model

Cross-Domain Feature Learning in Multimedia

Transfer Meets Hybrid: A Synthetic Approach for Cross-Domain Collaborative Filtering with Text

CCL: Cross-modal Correlation Learning with Multi-grained Fusion by Hierarchical Network.

Dual Modality Collaborative Learning for Cross-Source Remote Sensing Retrieval

Cross-domain Collaboration Recommendation.

Cross-Domain Federated Data Modeling on Non-IID Data

Contrastive Cross-domain Recommendation in Matching

Embedding Transfer with Enhanced Correlation Modeling for Cross-Domain Recommendation.

Triple Sequence Learning for Cross-domain Recommendation

Cross-domain Recommender Systems via Multimodal Domain Adaptation

Towards Cross-Domain Continual Learning

Cross Domain Deep Collaborative Filtering without Overlapping Data

Cross-Scene Joint Classification of Multisource Data With Multilevel Domain Adaption Network

Cross-domain Collaborative Filtering Via Bilinear Multilevel Analysis

Domain Invariant Subspace Learning for Cross-Modal Retrieval.

Cross-Domain Collaborative Filtering via Translation-based Learning

Collaborate decision network based on cross-modal attention for social media microblog recognition

Multi-view clustering via neighbor domain correlation learning

Multisource Collaborative Domain Generalization for Cross-Scene Remote Sensing Image Classification