Abstract:To overcome the challenges of limited samples, difficult acquisition, under-representation, and labeling in utilizing sonar images and deep learning (DL) for target detection, recognition, and segmentation tasks for full-class underwater targets, we propose the Seg2Sonar network based on spatially adaptive denormalization (SPADE). This network generates images through segmentation maps, thus eliminating the need for sample annotation. Additionally, we incorporate the skip-layer channel-wise excitation (SLE) module into the SPADE network to enhance feature extraction ability with minimal training samples. To improve the realism of generated images, we introduce the focal frequency loss (FFL) module, and propose the elasticity loss (EL) strategy to improve the random combination capability of the network, considering the characteristics of low resolution and severe distortion of sonar images. Furthermore, we propose a weight adjustment (WA) strategy that tackles the challenge of low and unbalanced feature representation with few samples by taking into account the unbalanced distribution of features using prior information. These four improvements enable efficient sample augmentation of sonar images with limited samples. Building upon the improved Seg2Sonar network, we propose an underwater full-class target augmentation strategy. Based on the imaging characteristics of sonar images, we classify underwater full-class targets into four categories: texture level, group level, shape level, and intensity level. We provide the corresponding augmentation strategies by leveraging similar features among sonar target images or adding external radar/optical features to supplement the diversity of features. Our experimental results demonstrate the efficacy of our proposed method in achieving sample augmentation of underwater full-class targets with minimal samples (less than ten) or even zero samples. The approach achieves about 90% accuracy in detection, recognition, and segmentation for all types of targets through DL methods. Our findings provide a promising solution for efficient sample augmentation of underwater full-class targets with limited samples.

GAN-based Sample Expansion for Underwater Acoustic Signal

Deep learning-based framework for expansion, recognition and classification of underwater acoustic signal

Depth-Conditioned GAN for Underwater Image Enhancement

Data Enhancement of Underwater High-Speed Vehicle Echo Signals Based on Improved Generative Adversarial Networks

An Underwater Wideband Sound Source Localization Method Based on Light Neural Network Structure

Underwater Target Recognition based on Multi-Decision LOFAR Spectrum Enhancement: A Deep Learning Approach

Underwater Target Recognition Based on Multi-Decision LOFAR Spectrum Enhancement: A Deep-Learning Approach

Underwater Acoustic Target Recognition Based on Data Augmentation and Residual CNN

Sample Augmentation Method for Side-Scan Sonar Underwater Target Images Based on CBL-sinGAN

Cross-domain Sound Recognition for Efficient Underwater Data Analysis

Hierarchical attention aggregation with multi-resolution feature learning for GAN-based underwater image enhancement

BO-GRNN: Machine Learning for Underwater Acoustic Source Localization

An Underwater Sonar Small Sample Image Transformation for Feature Domain Optimization

Data Augmentation and Classification of Sea–Land Clutter for Over-the-Horizon Radar Using AC-VAEGAN

Underwater target perception algorithm based on pressure sequence generative adversarial network

Underwater acoustic target recognition based on convolutional neural network and multi-feature fusion

Advanced acoustic leak detection in water distribution networks using integrated generative model

Underwater Acoustic Signal Noise Reduction Based on a Fully Convolutional Encoder-Decoder Neural Network

Conditional GANs for Sonar Image Filtering with Applications to Underwater Occupancy Mapping

Seg2Sonar: A Full-Class Sample Synthesis Method Applied to Underwater Sonar Image Target Detection, Recognition, and Segmentation Tasks

Few-shot learning for joint model in underwater acoustic target recognition