Abstract:In order to achieve sustainable development of marine fishery resources, effective supervise of trawl fishing during forbidden fishing period is of great significance. This paper addresses the challenges of poor generalization and the lack of unstructured information in the precise identification of single trawler fishing behavior. We propose a Transformer network with multi-source information fusion processing (MFGTN), which accurately classifies fishing vessels as single trawl or non-single trawl vessels. Firstly, a private fishing dataset of single trawl behavior is constructed by integrating AIS data with radar data, named HaiNan_SingleTrawlVessel(HN_STV). Subsequently, as fused data lacks unstructured information, it undergoes transformation into trajectory point images and recurrence plot images to reveal the internal structure of the fused data. As such, a visual module is introduced to handle the trajectory point images and recurrence plot images as a branch. Simultaneously, the fused data are input into a Double-Tower Transformer with Dual-gate structures to extract information in different dimensions of the time series and feature space as two separate branches. The Fast Attention module replaces the traditional Attention module to improve network speed and reduce memory consumption. Ultimately, the output of the three branches are fused and controlled by a Dual-gate structure that can autonomously learn to determine the network output. Experimental results show that compared to the current best-performing methods, the method discussed herein on the HN_STV dataset has improved the accuracy, recall, precision, and F1-score performance indicators by 2.34%, 2.46%, 0.97%, and 1.39%, respectively. The AUC area on the ROC curve increased by 4%. In a public dataset including three fishing activities, the proposed method improved accuracy, recall, precision, and F1-score by 2.95%, 2.59%, 2.25%, and 2.70%, respectively, and the AUC area on the ROC curve increased by 3%. And in all experiments, our network incurs the lowest time cost. Therefore, the method proposed herein demonstrates its advanced performance.

MFGTN: A Multi-Modal Fast Gated Transformer for Identifying Single Trawl Marine Fishing Vessel

Multi-class Fish Stock Statistics Technology Based on Object Classification and Tracking Algorithm

A Robust Underwater Multiclass Fish-School Tracking Algorithm

Fish Detection and Classification Based on Improved ViT

An Image Segmentation Method Based on Transformer and Multi-Scale Feature Fusion for UAV Marine Environment Monitoring

FMRFT: Fusion Mamba and DETR for Query Time Sequence Intersection Fish Tracking

Fish-TViT: A novel fish species classification method in multi water areas based on transfer learning and vision transformer

Fish Trajectory Extraction Based on Object Detection

TGFish: A Temporal Graph Convolutional Network for Fishing Effort Distribution Prediction

TCNet: A Transformer–CNN Hybrid Network for Marine Aquaculture Mapping from VHSR Images

VDU: VMS Dataset Upsampling Via Multi-Source Data Fusion for Trawlers

Identification of Fish Hunger Degree with Deformable Attention Transformer

Multi-Object Tracking by Iteratively Associating Detections with Uniform Appearance for Trawl-Based Fishing Bycatch Monitoring

HIT: Hybrid Interpolation for Trawlers Based on Deep Learning

A novel fish individual recognition method for precision farming based on knowledge distillation strategy and the range of the receptive field

Underwater Fish Image Recognition Based on Detection Transformer

FVID: Fishing Vessel Type Identification Based on VMS Trajectories

Fishing Vessel Type Recognition Based on Semantic Feature Vector

Fine-grained ship image classification and detection based on a vision transformer and multi-grain feature vector FPN model

CViTF-Net: A Convolutional and Visual Transformer Fusion Network for Small Ship Target Detection in Synthetic Aperture Radar Images

Intelligent Fish Detection System with Similarity-Aware Transformer