Abstract:Sea fog detection is a challenging and significant task in the field of remote sensing. Deep learning-based methods have shown promising potential, but require a large amount of pixel-level labeled data that are time-consuming and labor-intensive to acquire. To scale up the dataset and overcome the limitations of pixel-level annotation, we attempt to explore the existing knowledge from historical statistics for label-efficient sea fog detection. In this article, we propose an image-level weakly supervised sea fog detection dataset (WS-SFDD) and a novel weakly supervised sea fog detection framework via prototype learning, named ProCAM. According to the sea fog events recorded by the Marine Weather Review published quarterly by the National Meteorological Center of China, we collect the sea fog images from Himawari-8 satellite data and obtain free image-level labels to construct the dataset. However, with image-level annotations, the existing weakly supervised semantic segmentation (WSSS) methods mainly rely on class activation maps (CAMs) and have limitations when applied to such a specific scenario: 1) the pseudo-labels (PLs) mainly cover the most discriminative part of object regions that are incomplete; 2) the background is complex with varying atmospheric conditions, and it is difficult to distinguish sea fog from low clouds due to their high similarity in spectral characteristics; and 3) the co-occurring context, such as "sea," distracts the model and thus degrades the performance. To address the above issues, in our proposed ProCAM, we first design a prototype reactivation (PRA) module that reactivates self-similar sea fog regions by pixel-to-prototype feature matching to improve the robustness and completeness of CAMs. Then, we develop a pixel-to-prototype contrastive (PPC) learning method to increase the distance between sea fog and background in the embedding space for learning more discriminative dense features. Finally, a self-augmented regularization (SAR) strategy is presented to decouple sea fog from its co-ocurring context, and thus avoid background interference. Extensive experiments on the WS-SFDD dataset demonstrate that our proposed method ProCAM achieves superior performance with an score of 77.59% and a critical success index (CSI) of 63.39%. To the best of our knowledge, this is the first work to perform image-level weakly supervised sea fog detection in remote sensing images. The dataset and code are available at https://github.com/yixianghuang/ProCAM.

From Image-Level to Pixel-Level Labeling: A Weakly-Supervised Learning Method for Identifying Aquaculture Ponds Using Iterative Anti-Adversarial Attacks Guided by Aquaculture Features

Semi-supervised learning-based live fish identification in aquaculture using modified deep convolutional generative adversarial networks

Autonomous Extraction Technology for Aquaculture Ponds in Complex Geological Environments Based on Multispectral Feature Fusion of Medium-Resolution Remote Sensing Imagery

Finer Resolution Mapping Of Marine Aquaculture Areas Using Worldview-2 Imagery And A Hierarchical Cascade Convolutional Neural Network

MPG-Net: A Semantic Segmentation Model for Extracting Aquaculture Ponds in Coastal Areas from Sentinel-2 MSI and Planet SuperDove Images

Point-Based Weakly Supervised Deep Learning for Water Extraction from High-Resolution Remote Sensing Imagery.

NFANet: A Novel Method for Weakly Supervised Water Extraction from High-Resolution Remote Sensing Imagery

Automatic Extraction of Marine Aquaculture Zones from Optical Satellite Images by R3Det with Piecewise Linear Stretching.

Affinity LCFCN: Learning to Segment Fish with Weak Supervision

Coastal Aquaculture Mapping From Very High Spatial Resolution Imagery By Combining Object-Based Neighbor Features

A Modeling Method For Automatic Extraction Of Offshore Aquaculture Zones Based On Semantic Segmentation

Remote Sensing Classification of Offshore Seaweed Aquaculture Farms on Sample Dataset Amplification and Semantic Segmentation Model

Unsupervised Adversarial Domain Adaptation Based on Interpolation Image for Fish Detection in Aquaculture.

Extraction of Offshore Aquaculture Areas from Medium-Resolution Remote Sensing Images Based on Deep Learning

Weakly Supervised Sea Fog Detection in Remote Sensing Images via Prototype Learning

Non-contact weight estimation system for fish based on instance segmentation

Intelligent Annotation Algorithm Based on Deep-Sea Macrobenthic Images.

Extraction of Aquaculture Ponds along Coastal Region Using U2-Net Deep Learning Model from Remote Sensing Images

A New Method for Extracting Laver Culture Carriers Based on Inaccurate Supervised Classification with FCN-CRF

RCSANet: A Full Convolutional Network for Extracting Inland Aquaculture Ponds from High-Spatial-Resolution Images

GF-2 Remote Sensing Image Detection Method for Fouling in Aquaculture Wastewater from Seawater Ponds Based on a Multiscale Feature Extraction Network——taking Sandy Beaches As an Example