Abstract:Current cloud detection methods have demonstrated effectiveness by utilizing the rich spectral features of multi-spectral images. Compared to multispectral images, single-band infrared images offer higher efficiency in terms of sampling and processing speed. However, single-band cloud detection methods have not been fully developed, and existing methods based on multispectral cloud detection have some limitations when applied directly to single-band images: Firstly, they often blend shallow features containing spatial details with deep features providing high-level semantic information, yet struggle to disentangle features with strong discrimination representing cloud edges and bodies from limited information. Additionally, the correlation between features at different aspects is not fully reasoned, resulting in blurred boundary segmentation. To address these issues, we introduce a Multi-level Information Fusion Network (MIFNet) with an integrated edge information injection strategy. Our method effectively decouples clouds into their fundamental components: body and edge (Low-Frequency (LF) and High-Frequency (HF) components), enabling the comprehensive acquisition of strong discriminative features. Specifically, we propose an Edge Feature Extraction Module (EFEM) that isolates the cloud body through low-pass filtering, while the cloud’s edge is extracted by subtracting lower-level features from LF components. Furthermore, we employ a Feature Refinement Module (FRM) to locate the cloud body’s position precisely. Building upon this foundation, we devise a Graph Reasoning Module (GRM) to facilitate the full inference of feature correlations at different levels and to model the global interdependence between edges and semantics. Through comprehensive evaluations on benchmark datasets comprising infrared band images from Landsat 8 and MODIS satellites, we demonstrate that our proposed MIFNet outperforms state-of-the-art methods, yielding promising results in cloud detection accuracy. Our code is publicly available at https://github.com/KwunYat/MIFNet.

Information Fusion on the Two-Layer Network for Robust Estimation of Multiple Geometric Structures

Joint Network Topology Inference via Structured Fusion Regularization

Infrared and Visible Image Fusion Based on a Two-Stage Class Conditioned Auto-Encoder Network.

Information Fusion for Classification of Hyperspectral and LiDAR Data Using IP-CNN

Deep Neural Network Fusion via Graph Matching with Applications to Model Ensemble and Federated Learning.

Multi-level Information Fusion Network with Edge Information Injection for Single-band Cloud Detection

Fusing heterogeneous information for multi-modal attributed network embedding

UNIFusion: A Lightweight Unified Image Fusion Network

MIFNet: A Lightweight Multiscale Information Fusion Network

Multi-modal fusion network guided by prior knowledge for 3D CAD model recognition

Multi-fidelity information fusion with hierarchical surrogate guided by feature mapping

LFSimCC: Spatial fusion lightweight network for human pose estimation

Learning to fuse local geometric features for 3D rigid data matching

DmifNet:3D Shape Reconstruction Based on Dynamic Multi-Branch Information Fusion

TFIENet: Transformer Fusion Information Enhancement Network for Multi-Model 3D Object Detection

Latent Representation Learning Model for Multi-Band Images Fusion via Low-Rank and Sparse Embedding

A Novel Framework with Information Fusion and Neighborhood Enhancement for User Identity Linkage

MLFNet: Monocular lifting fusion network for 6DoF texture-less object pose estimation

TFIENet: Transformer Fusion Information Enhancement Network for Multimodel 3-D Object Detection.

Environmental-structure-perception-based adaptive pose fusion method for LiDAR-visual-inertial odometry

Global and Local Dual Fusion Network for Large-Ratio Cloud Occlusion Missing Information Reconstruction of a High-Resolution Remote Sensing Image