Abstract:Due to the strong speckle noise caused by the seabed reverberation which makes it difficult to extract discriminating and noiseless features of a target, recognition and classification of underwater targets using side-scan sonar (SSS) images is a big challenge. Moreover, unlike classification of optical images which can use a large dataset to train the classifier, classification of SSS images usually has to exploit a very small dataset for training, which may cause classifier overfitting. Compared with traditional feature extraction methods using descriptors—such as Haar, SIFT, and LBP—deep learning-based methods are more powerful in capturing discriminating features. After training on a large optical dataset, e.g., ImageNet, direct fine-tuning method brings improvement to the sonar image classification using a small-size SSS image dataset. However, due to the different statistical characteristics between optical images and sonar images, transfer learning methods—e.g., fine-tuning—lack cross-domain adaptability, and therefore cannot achieve very satisfactory results. In this paper, a multi-domain collaborative transfer learning (MDCTL) method with multi-scale repeated attention mechanism (MSRAM) is proposed for improving the accuracy of underwater sonar image classification. In the MDCTL method, low-level characteristic similarity between SSS images and synthetic aperture radar (SAR) images, and high-level representation similarity between SSS images and optical images are used together to enhance the feature extraction ability of the deep learning model. Using different characteristics of multi-domain data to efficiently capture useful features for the sonar image classification, MDCTL offers a new way for transfer learning. MSRAM is used to effectively combine multi-scale features to make the proposed model pay more attention to the shape details of the target excluding the noise. Experimental results of classification show that, in using multi-domain data sets, the proposed method is more stable with an overall accuracy of 99.21%, bringing an improvement of 4.54% compared with the fine-tuned VGG19. Results given by diverse visualization methods also demonstrate that the method is more powerful in feature representation by using the MDCTL and MSRAM.

Effective Underwater Acoustic Target Passive Localization of Using a Multi-Task Learning Model with Attention Mechanism: Analysis and Comparison under Real Sea Trial Datasets

Fine-Tuning Neural Network Based Target Localization Using Sources of Opportunity

Matched-field source localization using sparsely-coded neural network and data-model mixed training

A Novel AMSS-FFN for Underwater Multisource Localization Using Artificial Lateral Line.

Hybrid Underwater Acoustic Signal Multi-Target Recognition Based on DenseNet-LSTM with Attention Mechanism

A parallel convolutional neural network-transformer model for underwater target recognition based on multimodal feature learning

Underwater Target Classification at Greater Depths Using Deep Neural Network with Joint Multiple‐domain Feature

A Deep Learning Localization Method for Acoustic Source via Improved Input Features and Network Structure

A Multi-Task Learning Framework for Underwater Acoustic Channel Prediction: Performance Analysis on Real-World Data

Underwater Acoustic Target Classification Based on LOFAR Spectrum and Convolutional Neural Network.

Passive tracking of underwater acoustic targets based on multi-beam LOFAR and deep learning

Design of a Deep Learning-Based Underwater Acoustic Sensor Transceiver

Phase Space Reconstruction and Self-Attention Convolutional Neural Network for Sound Source Ranging with Trial Data

Underwater Passive Target Tracking Based On CNN-LSTM-Attention.

A Multi-Domain Collaborative Transfer Learning Method with Multi-Scale Repeated Attention Mechanism for Underwater Side-Scan Sonar Image Classification

Experimental Results of Underwater Sound Speed Profile Inversion by Few-shot Multi-task Learning

Advancing Robust Underwater Acoustic Target Recognition Through Multitask Learning and Multi-Gate Mixture of Experts.

Underwater Acoustic Target Recognition Method Based on Feature Fusion and Residual CNN

Adversarial Multi-Task Underwater Acoustic Target Recognition: Toward Robustness Against Various Influential Factors.

Underwater target recognition based on adaptive multi-feature fusion network

A Multi-Scale Coordinate Embedded Dual-Path U-Net for Shallow-Sea Source Localization