Abstract:To overcome the challenges of limited samples, difficult acquisition, under-representation, and labeling in utilizing sonar images and deep learning (DL) for target detection, recognition, and segmentation tasks for full-class underwater targets, we propose the Seg2Sonar network based on spatially adaptive denormalization (SPADE). This network generates images through segmentation maps, thus eliminating the need for sample annotation. Additionally, we incorporate the skip-layer channel-wise excitation (SLE) module into the SPADE network to enhance feature extraction ability with minimal training samples. To improve the realism of generated images, we introduce the focal frequency loss (FFL) module, and propose the elasticity loss (EL) strategy to improve the random combination capability of the network, considering the characteristics of low resolution and severe distortion of sonar images. Furthermore, we propose a weight adjustment (WA) strategy that tackles the challenge of low and unbalanced feature representation with few samples by taking into account the unbalanced distribution of features using prior information. These four improvements enable efficient sample augmentation of sonar images with limited samples. Building upon the improved Seg2Sonar network, we propose an underwater full-class target augmentation strategy. Based on the imaging characteristics of sonar images, we classify underwater full-class targets into four categories: texture level, group level, shape level, and intensity level. We provide the corresponding augmentation strategies by leveraging similar features among sonar target images or adding external radar/optical features to supplement the diversity of features. Our experimental results demonstrate the efficacy of our proposed method in achieving sample augmentation of underwater full-class targets with minimal samples (less than ten) or even zero samples. The approach achieves about 90% accuracy in detection, recognition, and segmentation for all types of targets through DL methods. Our findings provide a promising solution for efficient sample augmentation of underwater full-class targets with limited samples.

U-SAS: U-Shape Network with Multi-Level Enhancement and Global Decoding for Synthetic Aperture Sonar Image Semantic Segmentation

Shallow-water Wideband Low-Frequency Synthetic Aperture Sonar for an Autonomous Underwater Vehicle

Iterative, Deep, and Unsupervised Synthetic Aperture Sonar Image Segmentation

Dual Spatial Attention Network for Underwater Object Detection With Sonar Imagery

SADA-Net: A Shape Feature Optimization and Multiscale Context Information-Based Water Body Extraction Method for High-Resolution Remote Sensing Images

A Multi-Scale Generative Adversarial Network for Underwater Sonar Image Super-Resolution

Side-Scan Sonar Image Segmentation Based on Multi-Channel Fusion Convolution Neural Networks

Image-to-Height Domain Translation for Synthetic Aperture Sonar

Underwater sonar image segmentation combining pixel-level and region-level information

SonarNet: Hybrid CNN-Transformer-HOG Framework and Multifeature Fusion Mechanism for Forward-Looking Sonar Image Segmentation

D4SC: Deep Supervised Semantic Segmentation for Seabed Characterization and Uncertainty Estimation for Large Scale Mapping

UW-SDF: Exploiting Hybrid Geometric Priors for Neural SDF Reconstruction from Underwater Multi-view Monocular Images

A Network for Merging SAR Image Sea-Land Segmentation and Coastline Detection Tasks

Multi-Scale Convolutional Neural Network for SAR Image Semantic Segmentation

Combinational Fusion and Global Attention of the Single-Shot Method for Synthetic Aperture Radar Ship Detection.

Advances in Self-Supervised Learning for Synthetic Aperture Sonar Data Processing, Classification, and Pattern Recognition

Segmentation of sonar imagery using convolutional neural networks and Markov random field

A novel target detection method with dual‐domain multi‐frequency feature in side‐scan sonar images

Seg2Sonar: A Full-Class Sample Synthesis Method Applied to Underwater Sonar Image Target Detection, Recognition, and Segmentation Tasks

A Shadow Capture Deep Neural Network for Underwater Forward-Looking Sonar Image Detection

An Improved SAR Image Semantic Segmentation Deeplabv3+ Network Based on the Feature Post-Processing Module