Abstract:To overcome the challenges of limited samples, difficult acquisition, under-representation, and labeling in utilizing sonar images and deep learning (DL) for target detection, recognition, and segmentation tasks for full-class underwater targets, we propose the Seg2Sonar network based on spatially adaptive denormalization (SPADE). This network generates images through segmentation maps, thus eliminating the need for sample annotation. Additionally, we incorporate the skip-layer channel-wise excitation (SLE) module into the SPADE network to enhance feature extraction ability with minimal training samples. To improve the realism of generated images, we introduce the focal frequency loss (FFL) module, and propose the elasticity loss (EL) strategy to improve the random combination capability of the network, considering the characteristics of low resolution and severe distortion of sonar images. Furthermore, we propose a weight adjustment (WA) strategy that tackles the challenge of low and unbalanced feature representation with few samples by taking into account the unbalanced distribution of features using prior information. These four improvements enable efficient sample augmentation of sonar images with limited samples. Building upon the improved Seg2Sonar network, we propose an underwater full-class target augmentation strategy. Based on the imaging characteristics of sonar images, we classify underwater full-class targets into four categories: texture level, group level, shape level, and intensity level. We provide the corresponding augmentation strategies by leveraging similar features among sonar target images or adding external radar/optical features to supplement the diversity of features. Our experimental results demonstrate the efficacy of our proposed method in achieving sample augmentation of underwater full-class targets with minimal samples (less than ten) or even zero samples. The approach achieves about 90% accuracy in detection, recognition, and segmentation for all types of targets through DL methods. Our findings provide a promising solution for efficient sample augmentation of underwater full-class targets with limited samples.

A Sample Augmentation Method for Side-Scan Sonar Full-Class Images That Can Be Used for Detection and Segmentation

Image Stitching and Target Perception for Autonomous Underwater Vehicle-collected Side-Scan Sonar Images

SSS Underwater Target Image Samples Augmentation Based on the Cross-Domain Mapping Relationship of Images of the Same Physical Object

Sample Augmentation Method for Side-Scan Sonar Underwater Target Images Based on CBL-sinGAN

Seg2Sonar: A Full-Class Sample Synthesis Method Applied to Underwater Sonar Image Target Detection, Recognition, and Segmentation Tasks

An Underwater Image Enhancement Model for Domain Adaptation

DS-SIAUG: A Self-Training Approach Using a Disrupted Student Model for Enhanced Side-Scan Sonar Image Augmentation

Multi-Modal Multi-Stage Underwater Side-Scan Sonar Target Recognition Based on Synthetic Images

Side-Scan Sonar Image Generation Under Zero and Few Samples for Underwater Target Detection

Real-time underwater target detection for AUV using side scan sonar images based on deep learning

Underwater Target Detection Using Side-Scan Sonar Images Based on Upsampling and Downsampling

An Underwater Side-Scan Sonar Transfer Recognition Method Based on Crossed Point-to-Point Second-Order Self-Attention Mechanism

Small-Sample Underwater Target Detection: A Joint Approach Utilizing Diffusion and YOLOv7 Model

Side-Scan Sonar Image Segmentation Based on Multi-Channel Fusion Convolution Neural Networks

Sonar Image Target Detection Based on Simulated Stain-like Noise and Shadow Enhancement in Optical Images under Zero-Shot Learning

Underwater sonar image segmentation combining pixel-level and region-level information

Side-Scan Sonar Underwater Target Detection: Combining the Diffusion Model With an Improved YOLOv7 Model

Underwater small target detection based on dynamic convolution and attention mechanism

Computer vision methods for side scan sonar imagery

Instance Segmentation of Underwater Images by Using Deep Learning

Deep Learning from Shallow Dives: Sonar Image Generation and Training for Underwater Object Detection