Abstract:Cross-modal hashing is an important tool for retrieving useful information from very-high-resolution (VHR) optical images and synthetic aperture radar (SAR) images. Dealing with the intermodal discrepancies, including both spatial–spectral and visual semantic aspects, between VHR and SAR images is extremely vital to generate high-quality common hash codes in the Hamming space. However, existing cross-modal hashing methods ignore the spatial–spectral discrepancy when representing VHR and SAR images. Moreover, existing methods employ derived supervised signals, such as pairwise training images, to implicitly guide hashing learning, which fails to effectively deal with the visual semantic discrepancy, i.e., cannot adequately preserve the intraclass similarity and interclass discrimination between VHR and SAR images. To address these drawbacks, this article proposes a multisensor fusion and explicit semantic preserving-based deep Hashing method, termed as MsEspH, which can effectively deal with the discrepancies. Specifically, we design a novel cross-modal hashing network to eliminate the spatial–spectral discrepancies by fusing extra multispectral images (MSIs), which are generated in real time by a generative adversarial network. Then, we propose an explicit semantic preserving-based objective function by analyzing the connection between classification and hash learning. The objective function can preserve the intraclass similarity and interclass discrimination with class labels directly. Moreover, we theoretically verify that hash learning and classification can be unified into a learning framework under certain conditions. To evaluate our method, we construct and release a large-scale VHR-SAR image dataset. Extensive experiments on the dataset demonstrate that our method outperforms various state-of-the-art cross-modal hashing methods.

A Deep Cross-Modality Hashing Network for SAR and Optical Remote Sensing Images Retrieval

Semantic Consistency Hashing for Cross-Modal Retrieval

A Deep Cross-Modal Hashing Technique for Large-Scale SAR and VHR Image Retrieval

Dual Modality Collaborative Learning for Cross-Source Remote Sensing Retrieval

Retrieval Across Optical and SAR Images with Deep Neural Network.

Consistency Center-Based Deep Cross-Modal Hashing for Multisource Remote Sensing Image Retrieval

Multisensor Fusion and Explicit Semantic Preserving-Based Deep Hashing for Cross-Modal Remote Sensing Image Retrieval

Robust Cross-Modal Remote Sensing Image Retrieval Via Maximal Correlation Augmentation

Deep Multiscale Fine-Grained Hashing for Remote Sensing Cross-Modal Retrieval

A Discriminative Distillation Network for Cross-Source Remote Sensing Image Retrieval

HGR Maximal Correlation Augmented Cross-Modal Remote Sensing Retrieval

Learning Source-Invariant Deep Hashing Convolutional Neural Networks for Cross-Source Remote Sensing Image Retrieval.

A Deep Semantic Alignment Network for the Cross-Modal Image-Text Retrieval in Remote Sensing

Cross-Modal Hashing With Feature Semi-Interaction and Semantic Ranking for Remote Sensing Ship Image Retrieval

Deep Multi-Similarity Hashing with Spatial-Enhanced Learning for Remote Sensing Image Retrieval

Deep Hashing Network Based on Split Channels for Hybrid-Source Remote Sensing Image Retrieval

An Unsupervised Cross-Modal Hashing Method Robust to Noisy Training Image-Text Correspondences in Remote Sensing

Work Together: Correlation-Identity Reconstruction Hashing for Unsupervised Cross-modal Retrieval

A Deep Hashing Technique for Remote Sensing Image-Sound Retrieval.

Deep Shared Proxy Construction Hashing for Cross-Modal Remote Sensing Image Fast Target Retrieval

MCRN: A Multi-source Cross-modal Retrieval Network for Remote Sensing