Abstract:Video-based detection infrastructure is crucial for promoting connected and autonomous shipping (CAS) development, which provides critical on-site traffic data for maritime participants. Ship behavior analysis, one of the fundamental tasks for fulfilling smart video-based detection infrastructure, has become an active topic in the CAS community. Previous studies focused on ship behavior analysis by exploring spatial-temporal information from automatic identification system (AIS) data, and less attention was paid to maritime surveillance videos. To bridge the gap, we proposed an ensemble you only look once (YOLO) framework for ship behavior analysis. First, we employed the convolutional neural network in the YOLO model to extract multi-scaled ship features from the input ship images. Second, the proposed framework generated many bounding boxes (i.e., potential ship positions) based on the object confidence level. Third, we suppressed the background bounding box interferences, and determined ship detection results with intersection over union (IOU) criterion, and thus obtained ship positions in each ship image. Fourth, we analyzed spatial-temporal ship behavior in consecutive maritime images based on kinematic ship information. The experimental results have shown that ships are accurately detected (i.e., both of the average recall and precision rate were higher than 90%) and the historical ship behaviors are successfully recognized. The proposed framework can be adaptively deployed in the connected and autonomous vehicle detection system in the automated terminal for the purpose of exploring the coupled interactions between traffic flow variation and heterogeneous detection infrastructures, and thus enhance terminal traffic network capacity and safety.

Challenges in video based object detection in maritime scenario using computer vision

Video Processing from Electro-optical Sensors for Object Detection and Tracking in Maritime Environment: A Survey

Are Object Detection Assessment Criteria Ready for Maritime Computer Vision?

Object Detection in Image with Complex Background

Research on Vision-Based Object Detection Algorithm for Marine Obstacles

A Guide to Image and Video based Small Object Detection using Deep Learning : Case Study of Maritime Surveillance

SeaDSC: A video-based unsupervised method for dynamic scene change detection in unmanned surface vehicles

Computer Vision For Ocean Observing

The Key Technologies of Marine Multiobjective Ship Monitoring and Tracking Based on Computer Vision

Vision-Based Autonomous Navigation for Unmanned Surface Vessel in Extreme Marine Conditions

Video-Based Detection Infrastructure Enhancement for Automated Ship Recognition and Behavior Analysis

Sea-Sky Line and its Nearby Ships Detection Based on the Motion Attitude of Visible Light Sensors

Marine Vision-Based Situational Awareness Using Discriminative Deep Learning: A Survey

1st Workshop on Maritime Computer Vision (MaCVi) 2023: Challenge Results

Role and Integration of Image Processing Systems in Maritime Target Tracking

Automated Ship Detection from Optical Remote Sensing Images

Sea-Surface Object Detection Based on Electro-Optical Sensors: A Review

A review of intelligent ship marine object detection based on RGB camera

Research Challenges, Recent Advances, and Popular Datasets in Deep Learning-Based Underwater Marine Object Detection: A Review

Ship Detection and Tracking Method for Satellite Video Based on Multiscale Saliency and Surrounding Contrast Analysis

EEG-Based Maritime Object Detection for IoT-Driven Surveillance Systems in Smart Ocean