Abstract:Achieving a balance between spectral resolution and spatial resolution in multi-spectral remote sensing images is challenging due to physical constraints. Consequently, pan-sharpening technology was developed to address this challenge. While significant progress was recently achieved in deep-learning-based pan-sharpening techniques, most existing deep learning approaches face two primary limitations: (1) convolutional neural networks (CNNs) struggle with long-range dependency issues, and (2) significant detail loss during deep network training. Moreover, despite these methods' pan-sharpening capabilities, their generalization to full-sized raw images remains problematic due to scaling disparities, rendering them less practical. To tackle these issues, we introduce in this study a multi-spectral remote sensing image fusion network, termed TAMINet, which leverages a two-stream coordinate attention mechanism and multi-detail injection. Initially, a two-stream feature extractor augmented with the coordinate attention (CA) block is employed to derive modal-specific features from low-resolution multi-spectral (LRMS) images and panchromatic (PAN) images. This is followed by feature-domain fusion and pan-sharpening image reconstruction. Crucially, a multi-detail injection approach is incorporated during fusion and reconstruction, ensuring the reintroduction of details lost earlier in the process, which minimizes high-frequency detail loss. Finally, a novel hybrid loss function is proposed that incorporates spatial loss, spectral loss, and an additional loss component to enhance performance. The proposed methodology's effectiveness was validated through experiments on WorldView-2 satellite images, IKONOS, and QuickBird, benchmarked against current state-of-the-art techniques. Experimental findings reveal that TAMINet significantly elevates the pan-sharpening performance for large-scale images, underscoring its potential to enhance multi-spectral remote sensing image quality.

Cross-Modality Interaction Network for Pan-Sharpening

SSETPAN: Spatial-Spectral Enhanced Transformer Based Network for Pansharpening

Efficient and Accurate Hyperspectral Pansharpening Using 3D VolumeNet and 2.5D Texture Transfer

DuCoFPan: Dual-Condition Flow-based Network for Pan-sharpening

Cross-Interaction Kernel Attention Network for Pansharpening

PAN-Guided Band-Aware Multi-Spectral Feature Enhancement for Pan-Sharpening

DCPNet: A Dual-Task Collaborative Promotion Network for Pansharpening

Progressive Pan-Sharpening Via Cross-Scale Collaboration Networks

Convolutional LSTM-Based Hierarchical Feature Fusion for Multispectral Pan-Sharpening

Multiscale Dual-Domain Guidance Network for Pan-Sharpening

Mutual Information-driven Pan-sharpening

MFITN: A Multilevel Feature Interaction Transformer Network for Pansharpening

Multispectral Pansharpening Based on Multisequence Convolutional Recurrent Neural Network

Spatial-Frequency Domain Information Integration for Pan-Sharpening

Asymmetric Bidirectional Fusion Network for Remote Sensing Pansharpening

Multispectral Pan-sharpening via Dual-Channel Convolutional Network with Convolutional LSTM Based Hierarchical Spatial-Spectral Feature Fusion

Multispectral Image Pan-Sharpening Guided by Component Substitution Model

Pan-Sharpening Network of Multi-Spectral Remote Sensing Images Using Two-Stream Attention Feature Extractor and Multi-Detail Injection (TAMINet)

Spatial and Spectral Extraction Network With Adaptive Feature Fusion for Pansharpening

CMT: Cross Modulation Transformer with Hybrid Loss for Pansharpening

DMCSC: Deep Multisource Convolutional Sparse Coding Model for Pansharpening