Visual Ship Image Synthesis and Classification Framework Based on Attention-DCGAN

Yuqing Xiao,Liang Luo,Boxiang Yu,Shengchen Ji

DOI: https://doi.org/10.1007/s44196-024-00553-1

IF: 2.259

2024-06-12

International Journal of Computational Intelligence Systems

Abstract:To improving ship image generation and classification tasks, a deep convolution generative adversarial network based on attention mechanism (ADCGAN) model was constructed. The rectified linear unit (ReLU) activation function was adopted, and three Deconv layers and Conv layers were added to both the generator and discriminator. Subsequently, an attention mechanism was added to the generator, while spectral normalization (SN) was added to the discriminator. Mean squared error (MSE) was used as loss function to stabilize the training process. Furthermore, ship classification tasks were performed using the generated ship images by end-to-end training of the classification network, enabling ship data augmentation and co-learning with other tasks. Experimental results on the Ship700 and Seaship7000 datasets demonstrate that the ADCGAN model can generate clear and robust ship images, with PSNR, LIPIPS, MS-SSIM values of 20.279 and 27.523, 0.596 and 0.096, 0.781 and 0.947, respectively. The effectiveness of the proposed method in ship image classification tasks was also verified, providing a data foundation for other collaborative tasks.

computer science, artificial intelligence, interdisciplinary applications

What problem does this paper attempt to address?

The paper aims to address several key issues in the tasks of ship image generation and classification. Specifically: 1. **Data insufficiency**: Collecting high-quality ship images in marine environments is very difficult and costly, leading to severe data insufficiency problems for unmanned systems in detection, recognition, and tracking tasks. 2. **Quality and diversity of generated images**: Although existing Deep Convolutional Generative Adversarial Networks (DCGAN) have achieved some success in ship image generation, they still suffer from mode collapse and training instability issues. To address these problems, the authors propose an Attention-based Deep Convolutional Generative Adversarial Network (ADCGAN). This model improves the quality of generated images by introducing attention mechanisms and spectral normalization and stabilizes the training process by using the Mean Squared Error (MSE) loss function. Additionally, the model achieves collaborative learning of image generation and ship classification tasks through end-to-end training, thereby providing an enhanced data foundation to support other related tasks. Experimental results show that the ADCGAN model can generate clear and robust ship images on the Ship700 and Seaship7000 datasets and performs excellently in ship classification tasks.

Visual Ship Image Synthesis and Classification Framework Based on Attention-DCGAN

Enhancing Ship Classification in Optical Satellite Imagery: Integrating Convolutional Block Attention Module with ResNet for Improved Performance

A Ship Detection Method in Infrared Remote Sensing Images Based on Image Generation and Causal Inference

DCNN-based Ship Classification Using Enhanced Edge Information and Inception Module

An Intelligent Ship Image/Video Detection and Classification Method with Improved Regressive Deep Convolutional Neural Network

SAR Image Ship Object Generation and Classification With Improved Residual Conditional Generative Adversarial Network

An Improved Attention-Guided Network for Arbitrary-Oriented Ship Detection in Optical Remote Sensing Images

Image Enhancement Driven by Object Characteristics and Dense Feature Reuse Network for Ship Target Detection in Remote Sensing Imagery

Ship Object Detection of Remote Sensing Image Based on Visual Attention

Label Smoothing Auxiliary Classifier Generative Adversarial Network with Triplet Loss for SAR Ship Classification

Attention-Guided Convolution Neural Network Assisted With Handcrafted Features for Ship Classification in Low-Resolution Sentinel-1 SAR Image Data

Ship Classification in High-Resolution SAR Images Using Deep Learning of Small Datasets

A Marine Small-Targets Classification Algorithm Based on Improved Convolutional Neural Networks

Supervised Multi-Scale Attention-Guided Ship Detection in Optical Remote Sensing Images

Deep learning for autonomous ship-oriented small ship detection

Ship trajectory prediction model based on GAN and attention mechanism

Fine-grained Ship Classification Based on Deep Residual Learning for High-Resolution SAR Images

Adaptive Selecting and Learning Network and a New Benchmark for Imbalanced Fine-Grained Ship Classification

Data augmentation and deep neural network classification based on ship radiated noise

Ship Detection in Low-Quality SAR Images via an Unsupervised Domain Adaption Method

An Image Classification Method of Unbalanced Ship Coating Defects Based on DCCVAE-ACWGAN-GP