Abstract:With the extremely rapid advances in remote sensing (RS) technology, a great quantity of Earth observation (EO) data featuring considerable and complicated heterogeneity is readily available nowadays, which renders researchers an opportunity to tackle current geoscience applications in a fresh way. With the joint utilization of EO data, much research on multimodal RS data fusion has made tremendous progress in recent years, yet these developed traditional algorithms inevitably meet the performance bottleneck due to the lack of the ability to comprehensively analyse and interpret these strongly heterogeneous data. Hence, this non-negligible limitation further arouses an intense demand for an alternative tool with powerful processing competence. Deep learning (DL), as a cutting-edge technology, has witnessed remarkable breakthroughs in numerous computer vision tasks owing to its impressive ability in data representation and reconstruction. Naturally, it has been successfully applied to the field of multimodal RS data fusion, yielding great improvement compared with traditional methods. This survey aims to present a systematic overview in DL-based multimodal RS data fusion. More specifically, some essential knowledge about this topic is first given. Subsequently, a literature survey is conducted to analyse the trends of this field. Some prevalent sub-fields in the multimodal RS data fusion are then reviewed in terms of the to-be-fused data modalities, i.e., spatiospectral, spatiotemporal, light detection and ranging-optical, synthetic aperture radar-optical, and RS-Geospatial Big Data fusion. Furthermore, We collect and summarize some valuable resources for the sake of the development in multimodal RS data fusion. Finally, the remaining challenges and potential future directions are highlighted.

Deep-Learning for Change Detection Using Multi-Modal Fusion of Remote Sensing Images: A Review

Deep Learning for Change Detection in Remote Sensing Images: Comprehensive Review and Meta-Analysis

A Review of Deep-Learning Methods for Change Detection in Multispectral Remote Sensing Images

Deep Learning-Based Change Detection in Remote Sensing Images: A Review

Advances and Challenges in Deep Learning-Based Change Detection for Remote Sensing Images: A Review through Various Learning Paradigms

A Survey on Deep Learning-Based Change Detection from High-Resolution Remote Sensing Images

Developments in deep learning for change detection in remote sensing: A review

Remote Sensing Image Change Detection Based on Deep Learning: Multi-Level Feature Cross-Fusion with 3D-Convolutional Neural Networks

Change Detection Methods for Remote Sensing in the Last Decade: A Comprehensive Review

Deep Learning in Multimodal Remote Sensing Data Fusion: A Comprehensive Review

Deep learning in remote sensing: a review

A Hybrid Metaheuristic and Deep Learning Approach for Change Detection in Remote Sensing Data

A Deep Learning Based Platform for Remote Sensing Images Change Detection Integrating Crowdsourcing and Active Learning

Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources

MFDS-Net: Multiscale Feature Depth-Supervised Network for Remote Sensing Change Detection With Global Semantic and Detail Information

Change Detection Method for High Resolution Remote Sensing Images Using Deep Learning

Multimodal Co-Learning for Building Change Detection: A Domain Adaptation Framework Using VHR Images and Digital Surface Models

Novel Change Detection Framework in Remote Sensing Imagery Using Diffusion Models and Structural Similarity Index (SSIM)

SatelliteChangeNet: Deep Learning approach for Detection & Prediction

Remote Sensing Object Detection in the Deep Learning Era—A Review