Abstract:Ship instance segmentation in synthetic aperture radar (SAR) images is a hard and challenging task, which not only locates ships but also obtains their shapes with pixel-level masks. However, in ocean SAR images, because of the consistent reflective intensities of ships, the appearances of different ships are similar, thus making it far too difficult to distinguish ships when they are in densely packed groups. Especially when ships have incline directions and large aspect ratios, the horizontal bounding boxes (HB-Boxes) used by all the instance-segmentation networks that we know so far inevitably contain redundant backgrounds, docks, and even other ships, which mislead the following segmentation. To solve this problem, a novel ship instance-segmentation network, called SRNet, is proposed with rotated bounding boxes (RB-Boxes), which are taken as the foundation of segmentation. Along the directions of ships, the RB-Boxes can surround the ships tightly, but a minor deviation will corrupt the integrity of the ships’ masks. To improve the performance of the RB-Boxes, a dual feature alignment module (DAM) was designed to obtain the representative features with the direction and shape information of ships. On account of the difference between the classification task and regression task, two different sampling location calculation strategies were used in two convolutional kernels of the DAM, making these locations distributed dynamically on the ships’ bodies and along the ships’ boundaries. Moreover, to improve the effectiveness of training, a new adaptive Intersection-over-Union threshold (AIoU) was proposed based on the aspect-ratio information of ships to raise positive samples. To obtain the masks in the RB-Boxes, a new Mask-segmentation Head (MaskHead) with the twice sampling processes was explored. In experiments to evaluate the RB-Boxes, the accuracy of the RB-Boxes output from the Detection Head (DetHead) of SRNet outperformed eight rotated object-detection networks. In experiments to evaluate the final segmentation masks, compared with several classic and state-of-the-art instance-segmentation networks, our proposed SRNet achieved more accurate ship instance masks in SAR images. The ablation studies demonstrated the effectiveness of the DAM in the SRNet and the AIoU for our network training.

The segmentation algorithm of marine warship image based on mask RCNN

Global Mask R-CNN for marine ship instance segmentation

Comparison of two deep learning methods for ship target recognition with optical remotely sensed data

Relation and Application Method of Deep Learning Sea Target Detection and Segmentation Algorithm

SAR ship target detection method based on CNN structure with wavelet and attention mechanism

MSCF-Net: Attention-Guided Multi-Scale Context Feature Network for Ship Segmentation in Surveillance Videos

Ship recognition method combined with image segmentation and deep learning feature extraction in video surveillance

R-CNN-Based Ship Detection from High Resolution Remote Sensing Imagery

Integrate MSRCR and Mask R-CNN to Recognize Underwater Creatures on Small Sample Datasets

Remote sensing image segmentation based on improved Mask-RCNN

A Marine Small-Targets Classification Algorithm Based on Improved Convolutional Neural Networks

Target Detection of Marine Ships Based on a Cascade RCNN

An Enhanced SiamMask Network for Coastal Ship Tracking

Ship Instance Segmentation Based on Rotated Bounding Boxes for SAR Images

Image Enhancement Driven by Object Characteristics and Dense Feature Reuse Network for Ship Target Detection in Remote Sensing Imagery

Multitask Learning for SAR Ship Detection With Gaussian-Mask Joint Segmentation

Ship Segmentation and Georeferencing from Static Oblique View Images

Ship Contour Extraction From SAR Images Based on Faster R-CNN and Chan–Vese Model

Multilayer Feature Extraction Network for Military Ship Detection from High-Resolution Optical Remote Sensing Images

AUTOMATED MARINE OIL SPILL DETECTION USING DEEP LEARNING INSTANCE SEGMENTATION MODEL

A Mask Attention Interaction and Scale Enhancement Network for SAR Ship Instance Segmentation