Abstract:Sea fog detection (SFD) presents a significant challenge in the field of intelligent Earth observation, particularly in analyzing meteorological satellite imagery. Akin to various vision tasks, ImageNet pre-training is commonly used for pre-training SFD. However, in the context of multi-spectral meteorological satellite imagery, the initial step of deep learning has received limited attention. Recently, pre-training with Very High-Resolution (VHR) satellite imagery has gained increased popularity in remote-sensing vision tasks, showing the potential to replace ImageNet pre-training. However, it is worth noting that the meteorological satellite imagery applied in SFD, despite being an application of computer vision in remote sensing, differs greatly from VHR satellite imagery. To address the limitation of pre-training for SFD, this paper introduces a novel deep-learning paradigm to the meteorological domain driven by Masked Image Modeling (MIM). Our research reveals two key insights: (1) Pre-training with meteorological satellite imagery yields superior SFD performance compared to pre-training with nature imagery and VHR satellite imagery. (2) Incorporating the architectural characteristics of SFD models into a vanilla masked autoencoder (MAE) can augment the effectiveness of meteorological pre-training. To facilitate this research, we curate a pre-training dataset comprising 514,655 temporal multi-spectral meteorological satellite images, covering the Bohai Sea and Yellow Sea regions, which have the most sea fog occurrence. The longitude ranges from 115.00E to 128.75E, and the latitude ranges from 27.60N to 41.35N. Moreover, we introduce SeaMAE, a novel MAE that utilizes a Vision Transformer as the encoder and a convolutional hierarchical decoder, to learn meteorological representations. SeaMAE is pre-trained on this dataset and fine-tuned for SFD, resulting in state-of-the-art performance. For instance, using the ViT-Base as the backbone, SeaMAE pre-training which achieves 64.18% surpasses from-scratch learning, natural imagery pre-training, and VRH satellite imagery pre-training by 5.53%, 2.49%, and 2.21%, respectively, in terms of Intersection over Union of SFD.

Multi-source Data Fusion Network for Sea Fog Detection

Dual Branch Neural Network for Sea Fog Detection in Geostationary Ocean Color Imager

Coastal Sea Fog Detection Based on Multi-channel Fusion Transformer

Daytime Sea Fog Identification Based on Multi-Satellite Information and the ECA-TransUnet Model

An Early Warning Model for Starfish Disaster Based on Multi-Sensor Fusion

M4Fog: A Global Multi-Regional, Multi-Modal, and Multi-Stage Dataset for Marine Fog Detection and Forecasting to Bridge Ocean and Atmosphere

Fog Detection over China’s Adjacent Sea Area by using the MTSAT Geostationary Satellite Data

A scSE-LinkNet Deep Learning Model for Daytime Sea Fog Detection

SeaMAE: Masked Pre-Training with Meteorological Satellite Imagery for Sea Fog Detection

Fusion of Ocean Data from Multiple Sources Using Deep Learning: Utilizing Sea Temperature As an Example

Deep Convolutional Neural Network for Fog Detection.

Multimodal fusion for sea level anomaly forecasting

MMYFnet: Multi-Modality YOLO Fusion Network for Object Detection in Remote Sensing Images

A Correlation Context-Driven Method for Sea Fog Detection in Meteorological Satellite Imagery

Sea fog detection based on unsupervised domain adaptation

Improving Short-Term Prediction of Ocean Fog Using Numerical Weather Forecasts and Geostationary Satellite-Derived Ocean Fog Data Based on AutoML

MSSFNet: A Multiscale Spatial-Spectral Fusion Network for Extracting Offshore Floating Raft Aquaculture Areas in Multispectral Remote Sensing Images

MoANet: A Motion Attention Network for Sea Fog Detection in Time Series Meteorological Satellite Imagery

Short‐Term Sea Fog Area Forecast: A New Data Set and Deep Learning Approach

Intelligent model for offshore China sea fog forecasting

Automatic Detection of Daytime Sea Fog Based on Supervised Classification Techniques for FY-3D Satellite