Abstract:Video-based detection infrastructure is crucial for promoting connected and autonomous shipping (CAS) development, which provides critical on-site traffic data for maritime participants. Ship behavior analysis, one of the fundamental tasks for fulfilling smart video-based detection infrastructure, has become an active topic in the CAS community. Previous studies focused on ship behavior analysis by exploring spatial-temporal information from automatic identification system (AIS) data, and less attention was paid to maritime surveillance videos. To bridge the gap, we proposed an ensemble you only look once (YOLO) framework for ship behavior analysis. First, we employed the convolutional neural network in the YOLO model to extract multi-scaled ship features from the input ship images. Second, the proposed framework generated many bounding boxes (i.e., potential ship positions) based on the object confidence level. Third, we suppressed the background bounding box interferences, and determined ship detection results with intersection over union (IOU) criterion, and thus obtained ship positions in each ship image. Fourth, we analyzed spatial-temporal ship behavior in consecutive maritime images based on kinematic ship information. The experimental results have shown that ships are accurately detected (i.e., both of the average recall and precision rate were higher than 90%) and the historical ship behaviors are successfully recognized. The proposed framework can be adaptively deployed in the connected and autonomous vehicle detection system in the automated terminal for the purpose of exploring the coupled interactions between traffic flow variation and heterogeneous detection infrastructures, and thus enhance terminal traffic network capacity and safety.

Literature Review on Ship Localization, Classification, and Detection Methods Based on Optical Sensors and Neural Networks

A Review of Methods for Ship Detection with Electro-Optical Images in Marine Environments

Video Processing from Electro-optical Sensors for Object Detection and Tracking in Maritime Environment: A Survey

Sea-Surface Object Detection Based on Electro-Optical Sensors: A Review

Ship detection with deep learning: a survey

A Guide to Image and Video based Small Object Detection using Deep Learning : Case Study of Maritime Surveillance

Sailboat Detection Based on Automated Search Attention Mechanism and Deep Learning Models

Are Object Detection Assessment Criteria Ready for Maritime Computer Vision?

Ship detection and classification from optical remote sensing images: A survey

Ship Collision Avoidance Navigation Signal Recognition via Vision Sensing and Machine Forecasting

Ship Target Detection in Optical Remote Sensing Images Based on Spatial and Frequency Features

Ship Detection with Deep Learning in Optical Remote-Sensing Images: A Survey of Challenges and Advances

A Systematic Review of Ship Wake Detection Methods in Satellite Imagery

Sensors and AI Techniques for Situational Awareness in Autonomous Ships: A Review

Advancements in Ship Detection: Comparative Analysis of Optical and Hyperspectral Sensors

Video-Based Detection Infrastructure Enhancement for Automated Ship Recognition and Behavior Analysis

Ship Detection for Optical Remote Sensing Images Based on Visual Attention Enhanced Network

Research on Ship Detection Method of Optical Remote Sensing Image Based on Deep Learning

EEG-Based Maritime Object Detection for IoT-Driven Surveillance Systems in Smart Ocean

Ship Object Detection of Remote Sensing Image Based on Visual Attention

Maritime Search and Rescue Missions with Aerial Images: A Survey