Abstract:Introduction: With a higher degree of automation, fishing vessels have gradually begun adopting a fishing monitoring method that combines human and electronic observers. However, the objective data of electronic monitoring systems (EMS) has not yet been fully applied in various fishing boat scenarios such as ship behavior recognition. Methods: In order to make full use of EMS data and improve the accuracy of behaviors recognition of fishing vessels, the present study proposes applying popular deep learning technologies such as convolutional neural network, long short-term memory, and attention mechanism to Chub mackerel (Scomber japonicus) fishing vessel behaviors recognition. The operation process of Chub mackerel fishing vessels was divided into nine kinds of behaviors, such as "pulling nets", "putting nets", "fish pick", "reprint", etc. According to the characteristics of their fishing work, four networks with different convolutional layers were designed in the pre-experiment. And the feasibility of each network in behavior recognition of the fishing vessels was observed. The pre-experiment is optimized from the perspective of the data set and the network. From the standpoint of the data set, the size of the optimized data set is significantly reduced, and the original data characteristics are preserved as much as possible. From the perspective of the network, different combinations of pooling, long short-term memory(LSTM) network, and attention(including CBAM and SE) are added to the network, and their effects on training time and recognition effect are compared. Results: The experimental results reveal that the deep learning methods have outstanding performance in behaviors recognition of fishing vessels. The LSTM and SE module combination produced the most apparent optimization effect on the network, and the optimized model can achieve an F1 score of 97.12% in the test set, surpassing the classic ResNet, VGGNet, and AlexNet. Discussion: This research is of great significance to the management of intelligent fishery vessels and can promote the development of electronic monitoring systems for ships.

Dwarf Mongoose Optimization with Transfer Learning-Based Fish Behavior Classification Model

Multi-class Fish Stock Statistics Technology Based on Object Classification and Tracking Algorithm

Intelligent Fish Behavior Classification Using Modified Invasive Weed Optimization with Ensemble Fusion Model

Fish Detection and Classification Based on Improved ViT

Modified Kinetic Energy Feature-Based Graph Convolutional Network for Fish Appetite Grading Using Time-Limited Data in Aquaculture

Computer vision model with novel cuckoo search based deep learning approach for classification of fish image

An optimized deep network-based fish tracking and classification from underwater images

An Intelligent Deep Learning Enabled Marine Fish Species Detection and Classification Model

Intelligent Diagnosis of Fish Behavior Using Deep Learning Method

Automatic Recognition of Fish Behavior with a Fusion of RGB and Optical Flow Data Based on Deep Learning

FisHook -- An Optimized Approach to Marine Specie Classification using MobileNetV2

Movement Tracks for the Automatic Detection of Fish Behavior in Videos

Fish detection and species classification in underwater environments using deep learning with temporal information

CO‐WOA: Novel Optimization Approach for Deep Learning Classification of Fish Image

Multi-classification deep neural networks for identification of fish species using camera captured images

Real-time nondestructive fish behavior detecting in mixed polyculture system using deep-learning and low-cost devices

An improved dung beetle optimization with recurrent convolutional neural networks for efficient detection and classification of undersea water object images

Applications of Deep Learning in Fish Habitat Monitoring: A Tutorial and Survey

Developing machine learning methods for automatic recognition of fishing vessel behaviour in the Scomber japonicus fisheries

Pattern detection and prediction using deep learning for intelligent decision support to identify fish behaviour in aquaculture

Application of Deep Learning-Based Object Detection Techniques in Fish Aquaculture: A Review