Abstract:To overcome the challenges of limited samples, difficult acquisition, under-representation, and labeling in utilizing sonar images and deep learning (DL) for target detection, recognition, and segmentation tasks for full-class underwater targets, we propose the Seg2Sonar network based on spatially adaptive denormalization (SPADE). This network generates images through segmentation maps, thus eliminating the need for sample annotation. Additionally, we incorporate the skip-layer channel-wise excitation (SLE) module into the SPADE network to enhance feature extraction ability with minimal training samples. To improve the realism of generated images, we introduce the focal frequency loss (FFL) module, and propose the elasticity loss (EL) strategy to improve the random combination capability of the network, considering the characteristics of low resolution and severe distortion of sonar images. Furthermore, we propose a weight adjustment (WA) strategy that tackles the challenge of low and unbalanced feature representation with few samples by taking into account the unbalanced distribution of features using prior information. These four improvements enable efficient sample augmentation of sonar images with limited samples. Building upon the improved Seg2Sonar network, we propose an underwater full-class target augmentation strategy. Based on the imaging characteristics of sonar images, we classify underwater full-class targets into four categories: texture level, group level, shape level, and intensity level. We provide the corresponding augmentation strategies by leveraging similar features among sonar target images or adding external radar/optical features to supplement the diversity of features. Our experimental results demonstrate the efficacy of our proposed method in achieving sample augmentation of underwater full-class targets with minimal samples (less than ten) or even zero samples. The approach achieves about 90% accuracy in detection, recognition, and segmentation for all types of targets through DL methods. Our findings provide a promising solution for efficient sample augmentation of underwater full-class targets with limited samples.

Promptable Sonar Image Segmentation for Distance Measurement Using SAM

Image Stitching and Target Perception for Autonomous Underwater Vehicle-collected Side-Scan Sonar Images

Sonar Image Processing System For An Autonomous Underwater Vehicle (Auv)

Exploring the Feasibility of Affordable Sonar Technology: Object Detection in Underwater Environments Using the Ping 360

An Open-Source Platform For Underwater Image And Video Analytics

When SAM Meets Sonar Images

Integrating Sonar and Stereo Vision for Enhanced Subsea Infrastructure Maintenance

On-Line Multi-Class Segmentation of Side-Scan Sonar Imagery Using an Autonomous Underwater Vehicle

Sonar-Based Simultaneous Localization and Mapping Using the Semi-Direct Method

Sonar Image Coarse-to-Fine Few-Shot Segmentation Based on Object-Shadow Feature Pair Localization and Level Set Method

Performance Assessment of Feature Detection Methods for 2-D FS Sonar Imagery

Time and Cost-Efficient Bathymetric Mapping System using Sparse Point Cloud Generation and Automatic Object Detection

Synthetic Sonar Image Simulation with Various Seabed Conditions for Automatic Target Recognition

Seg2Sonar: A Full-Class Sample Synthesis Method Applied to Underwater Sonar Image Target Detection, Recognition, and Segmentation Tasks

Underwater sonar image segmentation combining pixel-level and region-level information

Computer vision methods for side scan sonar imagery

Ghost Removal from Forward-Scan Sonar Views near the Sea Surface for Image Enhancement and 3-D Object Modeling

Advanced deep learning framework for underwater object detection with multibeam forward-looking sonar

S3Simulator: A benchmarking Side Scan Sonar Simulator dataset for Underwater Image Analysis

Underwater Slam Algorithm Based on Image Sonar Salient Target Detection

Robust Imaging Sonar-based Place Recognition and Localization in Underwater Environments