Abstract:Herein, a two‐branch feature fusion neural network structure is proposed to classify the visible and infrared maritime vessels images simultaneously. Specifically, in this two‐branch neural network, one branch is based on a deep convolutional neural network that is used to extract the visible image features, while the other is a hybrid network structure that is a multi‐scale patch embedding network called MPANet. The experimental results on the visible and infrared spectrums (VAIS) dataset demonstrate that the introduced network achieves state‐of‐the‐art ship classification performance on visible images and paired visible and infrared ship images. Ship classification is an important technique for enhancing maritime management and security. Visible and infrared sensors are generally employed to deal with the challenging problem and improve classification performance. Herein, a two‐branch feature fusion neural network structure is proposed to classify the visible and infrared maritime vessel images simultaneously. Specifically, in this two‐branch neural network, one branch is based on a deep convolutional neural network that is used to extract the visible image features, while the other is a hybrid network structure that is a multi‐scale patch embedding network called MPANet. The sub‐network MPANet can extract fine‐ and coarse‐grained features, in which the pooling operation instead of the multi‐head attention mechanism is utilized to reduce memory consumption. When there are infrared images, it is used to extract the infrared image features, otherwise, this branch is also utilized to extract visible image features. Therefore, this dual network is suitable with or without infrared images. The experimental results on the visible and infrared spectrums (VAIS) dataset demonstrate that the introduced network achieves state‐of‐the‐art ship classification performance on visible images and paired visible and infrared ship images.

Comparative Ship Classification in Heterogeneous Dataset with Pre-trained Models

MS3Net: a deep ensemble learning approach for ship classification in heterogeneous remote sensing data

A public dataset for ship classification in remote sensing images

Ship Classification in High-Resolution SAR Images Using Deep Learning of Small Datasets

A novel ship classification network with cascade deep features for line-of-sight sea data

Ship classification for unbalanced SAR dataset based on convolutional neural network

Hierarchical Multilabel Ship Classification in Remote Sensing Images Using Label Relation Graphs

Comparative Analysis of CNN-Based Smart Pre-Trained Models for Object Detection on DOTA

Comparison of two deep learning methods for ship target recognition with optical remotely sensed data

Enhancing Ship Classification in Optical Satellite Imagery: Integrating Convolutional Block Attention Module with ResNet for Improved Performance

A Marine Small-Targets Classification Algorithm Based on Improved Convolutional Neural Networks

Attention-Guided Convolution Neural Network Assisted With Handcrafted Features for Ship Classification in Low-Resolution Sentinel-1 SAR Image Data

Adaptive Selecting and Learning Network and a New Benchmark for Imbalanced Fine-Grained Ship Classification

Multi-Level Cross-Modal Interactive-Network-Based Semi-Supervised Multi-Modal Ship Classification

Classification of ships using real and simulated data in a convolutional neural network

Utilizing Elephant Herd-Inspired Spiking Neural Networks for Enhanced Ship Detection and Classification in Marine Scene Matching

A Novel Multiscale Contrastive Learning Network for Fine-Grained Ocean Ship Classification

HOG-ShipCLSNet: A Novel Deep Learning Network With HOG Feature Fusion for SAR Ship Classification

An Intelligent Ship Image/Video Detection and Classification Method with Improved Regressive Deep Convolutional Neural Network

Ship recognition based on Hu invariant moments and convolutional neural network for video surveillance

Maritime vessel classification based on a dual network combining EfficientNet with a hybrid network MPANet