Abstract:Sea ice is one of the typical causes of marine disasters. Sea ice image classification is an important component of sea ice detection. Optical data contain rich spectral information, but they do not allow one to easily distinguish between ground objects with a similar spectrum and foreign objects with the same spectrum. Synthetic aperture radar (SAR) data contain rich texture information, but the data usually have a single source. The limitation of single-source data is that they do not allow for further improvements of the accuracy of remote sensing sea ice classification. In this paper, we propose a method for sea ice image classification based on deep learning and heterogeneous data fusion. Utilizing the advantages of convolutional neural networks (CNNs) in terms of depth feature extraction, we designed a deep learning network structure for SAR and optical images and achieve sea ice image classification through feature extraction and a feature-level fusion of heterogeneous data. For the SAR images, the improved spatial pyramid pooling (SPP) network was used and texture information on sea ice at different scales was extracted by depth. For the optical data, multi-level feature information on sea ice such as spatial and spectral information on different types of sea ice was extracted through a path aggregation network (PANet), which enabled low-level features to be fully utilized due to the gradual feature extraction of the convolution neural network. In order to verify the effectiveness of the method, two sets of heterogeneous sentinel satellite data were used for sea ice classification in the Hudson Bay area. The experimental results show that compared with the typical image classification methods and other heterogeneous data fusion methods, the method proposed in this paper fully integrates multi-scale and multi-level texture and spectral information from heterogeneous data and achieves a better classification effect (96.61%, 95.69%).

A Multi-Task Network with Dynamic Segmentation for Sea Ice Classification in Arctic Shipping Route Optimization

Real-time Water Area Segmentation for USV using Enhanced U-Net

MMSeaIce: a collection of techniques for improving sea ice mapping with a multi-task model

DF-UHRNet: A Modified CNN-Based Deep Learning Method for Automatic Sea Ice Classification from Sentinel-1A/B SAR Images

Arctic Sea Ice Concentration Prediction Using Spatial Attention Deep Learning

Enhancing sea ice segmentation in Sentinel-1 images with atrous convolutions

Precise and Fast Segmentation of Sea Ice in High-Resolution Images Based on Multiscale and Knowledge Distillation

The Identification of Ice Floes and Calculation of Sea Ice Concentration Based on a Deep Learning Method

Prediction of ship following behavior in ice-covered waters in the Northern Sea Route based on hybrid theory and data-driven approach

Dynamic Thresholding Fully Automated Sea Ice Extraction and Classification Methods Based on Multi-Source Remote-Sensing Data in the Yellow Sea and Bohai Sea Regions

Decoding the Partial Pretrained Networks for Sea-Ice Segmentation of 2021 Gaofen Challenge

Sea Ice Image Classification Based on Heterogeneous Data Fusion and Deep Learning

Breaking The Ice: Video Segmentation for Close-Range Ice-Covered Waters

An image augmentation‐based ice monitoring method for safe navigation of polar ships

Research on semantic segmentation algorithm of high latitude urban river ice based on deep transfer learning

Integrating a data-driven classifier and shape-modulated segmentation for sea-ice floe extraction

Deep learning techniques for enhanced sea-ice types classification in the Beaufort Sea via SAR imagery

MSCF-Net: Attention-Guided Multi-Scale Context Feature Network for Ship Segmentation in Surveillance Videos

Physics-informed Deep Convolutional Network for Combined Sea Ice Concentration and Velocity Prediction

Region-level labels in ice charts can produce pixel-level segmentation for Sea Ice types

Ship Navigation Route Planning Using Topology of Sea Ice Channels Extracted from High Resolution Satellite Images