Abstract:Herein, a two‐branch feature fusion neural network structure is proposed to classify the visible and infrared maritime vessels images simultaneously. Specifically, in this two‐branch neural network, one branch is based on a deep convolutional neural network that is used to extract the visible image features, while the other is a hybrid network structure that is a multi‐scale patch embedding network called MPANet. The experimental results on the visible and infrared spectrums (VAIS) dataset demonstrate that the introduced network achieves state‐of‐the‐art ship classification performance on visible images and paired visible and infrared ship images. Ship classification is an important technique for enhancing maritime management and security. Visible and infrared sensors are generally employed to deal with the challenging problem and improve classification performance. Herein, a two‐branch feature fusion neural network structure is proposed to classify the visible and infrared maritime vessel images simultaneously. Specifically, in this two‐branch neural network, one branch is based on a deep convolutional neural network that is used to extract the visible image features, while the other is a hybrid network structure that is a multi‐scale patch embedding network called MPANet. The sub‐network MPANet can extract fine‐ and coarse‐grained features, in which the pooling operation instead of the multi‐head attention mechanism is utilized to reduce memory consumption. When there are infrared images, it is used to extract the infrared image features, otherwise, this branch is also utilized to extract visible image features. Therefore, this dual network is suitable with or without infrared images. The experimental results on the visible and infrared spectrums (VAIS) dataset demonstrate that the introduced network achieves state‐of‐the‐art ship classification performance on visible images and paired visible and infrared ship images.

A transfer learning-based convolutional neural network and its novel application in ship spare-parts classification

An Intelligent Ship Image/Video Detection and Classification Method with Improved Regressive Deep Convolutional Neural Network

A Novel CNN Ensemble Framework for Bearing Surface Defects Classification Based on Transfer Learning

A Convolutional Neural Network for Heterogeneous Ship Images Classification

A Marine Small-Targets Classification Algorithm Based on Improved Convolutional Neural Networks

DCNN-based Ship Classification Using Enhanced Edge Information and Inception Module

A novel ship classification network with cascade deep features for line-of-sight sea data

Ship Classification in High-Resolution SAR Images Using Deep Learning of Small Datasets

A ship movement classification based on Automatic Identification System (AIS) data using Convolutional Neural Network

Senvis-Net: Learning from Imbalanced Machinery Data by Transferring Visual Element Detectors

Vessel trajectory classification via transfer learning with Deep Convolutional Neural Networks

Fine-grained ship image classification and detection based on a vision transformer and multi-grain feature vector FPN model

Enhancing Ship Classification in Optical Satellite Imagery: Integrating Convolutional Block Attention Module with ResNet for Improved Performance

Application of improved convolution neural network in classification and recommendation

Deep Feature Fusion Classification Model for Identifying Machine Parts

A bearing fault diagnosis approach based on an improved neural network combined with transfer learning

Maritime vessel classification based on a dual network combining EfficientNet with a hybrid network MPANet

A motor bearing fault diagnosis method based on multi-source data and one-dimensional lightweight convolution neural network

A transfer convolutional neural network for fault diagnosis based on ResNet-50

Maritime ship recognition based on convolutional neural network and linear weighted decision fusion for multimodal images

Research on Fault Diagnosis Method of Ship Equipment Based on Deep Convolutional Neural Network