Abstract:Introduction: With a higher degree of automation, fishing vessels have gradually begun adopting a fishing monitoring method that combines human and electronic observers. However, the objective data of electronic monitoring systems (EMS) has not yet been fully applied in various fishing boat scenarios such as ship behavior recognition. Methods: In order to make full use of EMS data and improve the accuracy of behaviors recognition of fishing vessels, the present study proposes applying popular deep learning technologies such as convolutional neural network, long short-term memory, and attention mechanism to Chub mackerel (Scomber japonicus) fishing vessel behaviors recognition. The operation process of Chub mackerel fishing vessels was divided into nine kinds of behaviors, such as "pulling nets", "putting nets", "fish pick", "reprint", etc. According to the characteristics of their fishing work, four networks with different convolutional layers were designed in the pre-experiment. And the feasibility of each network in behavior recognition of the fishing vessels was observed. The pre-experiment is optimized from the perspective of the data set and the network. From the standpoint of the data set, the size of the optimized data set is significantly reduced, and the original data characteristics are preserved as much as possible. From the perspective of the network, different combinations of pooling, long short-term memory(LSTM) network, and attention(including CBAM and SE) are added to the network, and their effects on training time and recognition effect are compared. Results: The experimental results reveal that the deep learning methods have outstanding performance in behaviors recognition of fishing vessels. The LSTM and SE module combination produced the most apparent optimization effect on the network, and the optimized model can achieve an F1 score of 97.12% in the test set, surpassing the classic ResNet, VGGNet, and AlexNet. Discussion: This research is of great significance to the management of intelligent fishery vessels and can promote the development of electronic monitoring systems for ships.

Multimodal Labor Exploitation Detections for Taiwan Distant Water Fishing Industry

Labor exploitation investigation using statistical and multiple object tracking assessment methods

Multi-class Fish Stock Statistics Technology Based on Object Classification and Tracking Algorithm

Online Fish Tracking with Portable Smart Device for Ocean Observatory Network

YoloXT: A Object Detection Algorithm for Marine Benthos

Improving Fishing Pattern Detection from Satellite AIS Using Data Mining and Machine Learning

Towards a responsible machine learning approach to identify forced labor in fisheries

An Activity Management System for Office Workers Using Multimodal Data

Enhanced Fishing Monitoring in the Central-Eastern North Pacific Using Deep Learning with Nightly Remote Sensing

Revealing global risks of labor abuse and illegal, unreported, and unregulated fishing

The Labour Rights Protection of Migrant Fishing Workers in Taiwan: Case Study of Nan-Fang-Ao Fishing Harbor

Development and Application of an Advanced Automatic Identification System (AIS)-Based Ship Trajectory Extraction Framework for Maritime Traffic Analysis

Multi-Object Tracking by Iteratively Associating Detections with Uniform Appearance for Trawl-Based Fishing Bycatch Monitoring

Multi-Modal Recognition of Worker Activity for Human-Centered Intelligent Manufacturing

Fishery catch records support machine learning-based prediction of illegal fishing off US West Coast

Agricultural Worker Tracking and Gesture Recognition System for Remote Assistance

FAD-SAR: A Novel Fishing Activity Detection System via Synthetic Aperture Radar Images Based on Deep Learning Method

Developing machine learning methods for automatic recognition of fishing vessel behaviour in the Scomber japonicus fisheries

Predicting Illegal Fishing on the Patagonia Shelf from Oceanographic Seascapes

Fine spatio-temporal prediction of fishing time using big data

Prediction of waterborne freight activity with Automatic identification System using Machine learning