Abstract:Sea ice is one of the typical causes of marine disasters. Sea ice image classification is an important component of sea ice detection. Optical data contain rich spectral information, but they do not allow one to easily distinguish between ground objects with a similar spectrum and foreign objects with the same spectrum. Synthetic aperture radar (SAR) data contain rich texture information, but the data usually have a single source. The limitation of single-source data is that they do not allow for further improvements of the accuracy of remote sensing sea ice classification. In this paper, we propose a method for sea ice image classification based on deep learning and heterogeneous data fusion. Utilizing the advantages of convolutional neural networks (CNNs) in terms of depth feature extraction, we designed a deep learning network structure for SAR and optical images and achieve sea ice image classification through feature extraction and a feature-level fusion of heterogeneous data. For the SAR images, the improved spatial pyramid pooling (SPP) network was used and texture information on sea ice at different scales was extracted by depth. For the optical data, multi-level feature information on sea ice such as spatial and spectral information on different types of sea ice was extracted through a path aggregation network (PANet), which enabled low-level features to be fully utilized due to the gradual feature extraction of the convolution neural network. In order to verify the effectiveness of the method, two sets of heterogeneous sentinel satellite data were used for sea ice classification in the Hudson Bay area. The experimental results show that compared with the typical image classification methods and other heterogeneous data fusion methods, the method proposed in this paper fully integrates multi-scale and multi-level texture and spectral information from heterogeneous data and achieves a better classification effect (96.61%, 95.69%).

Integrating a data-driven classifier and shape-modulated segmentation for sea-ice floe extraction

Multi-Scale Fish Segmentation Refinement and Missing Shape Recovery

A Multi-Task Network with Dynamic Segmentation for Sea Ice Classification in Arctic Shipping Route Optimization

Coarse-To-Fine Segmentation Refinement and Missing Shape Recovery for Halibut Fish

Segmenting sea ice floes in close-range optical imagery with active contour and foundation models

Towards a manual-free labelling approach for deep learning-based ice floe instance segmentation in airborne and high-resolution optical satellite images

Ice Floe Segmentation and Floe Size Distribution in Airborne and High-Resolution Optical Satellite Images: Towards an Automated Labelling Deep Learning Approach

Sea Ice Image Classification Based on Heterogeneous Data Fusion and Deep Learning

Sea Ice Extraction via Remote Sensed Imagery: Algorithms, Datasets, Applications and Challenges

MMSeaIce: a collection of techniques for improving sea ice mapping with a multi-task model

Dynamic Thresholding Fully Automated Sea Ice Extraction and Classification Methods Based on Multi-Source Remote-Sensing Data in the Yellow Sea and Bohai Sea Regions

Enhancing sea ice segmentation in Sentinel-1 images with atrous convolutions

Sea Ice Extraction via Remote Sensing Imagery: Algorithms, Datasets, Applications and Challenges

DF-UHRNet: A Modified CNN-Based Deep Learning Method for Automatic Sea Ice Classification from Sentinel-1A/B SAR Images

Decoding the Partial Pretrained Networks for Sea-Ice Segmentation of 2021 Gaofen Challenge

Image Processing for Identification of Sea-Ice Floes and the Floe Size Distributions

Concept-driven extraction of the Antarctic marginal sea ice zone from remote sensing image time series

Fine-Scale Sea Ice Segmentation for High-Resolution Satellite Imagery with Weakly-Supervised CNNs

The Identification of Ice Floes and Calculation of Sea Ice Concentration Based on a Deep Learning Method

Breaking The Ice: Video Segmentation for Close-Range Ice-Covered Waters

Automatic Extraction of Floating Ice at Antarctic Continental Margin from Remotely Sensed Imagery Using Object-Based Segmentation