Abstract:Video-based detection infrastructure is crucial for promoting connected and autonomous shipping (CAS) development, which provides critical on-site traffic data for maritime participants. Ship behavior analysis, one of the fundamental tasks for fulfilling smart video-based detection infrastructure, has become an active topic in the CAS community. Previous studies focused on ship behavior analysis by exploring spatial-temporal information from automatic identification system (AIS) data, and less attention was paid to maritime surveillance videos. To bridge the gap, we proposed an ensemble you only look once (YOLO) framework for ship behavior analysis. First, we employed the convolutional neural network in the YOLO model to extract multi-scaled ship features from the input ship images. Second, the proposed framework generated many bounding boxes (i.e., potential ship positions) based on the object confidence level. Third, we suppressed the background bounding box interferences, and determined ship detection results with intersection over union (IOU) criterion, and thus obtained ship positions in each ship image. Fourth, we analyzed spatial-temporal ship behavior in consecutive maritime images based on kinematic ship information. The experimental results have shown that ships are accurately detected (i.e., both of the average recall and precision rate were higher than 90%) and the historical ship behaviors are successfully recognized. The proposed framework can be adaptively deployed in the connected and autonomous vehicle detection system in the automated terminal for the purpose of exploring the coupled interactions between traffic flow variation and heterogeneous detection infrastructures, and thus enhance terminal traffic network capacity and safety.

Multimodal Perception Integrating Point Cloud and Light Field for Ship Autonomous Driving

Reliable LiDAR-based ship detection and tracking for Autonomous Surface Vehicles in busy maritime environments

Multi-modal Information Fusion for LiDAR-based 3D Object Detection Framework

A New Multi-Sensor Fusion Approach for Integrated Ship Motion Perception in Inland Waterways

Research on Surface Environment Perception Via Camera-LiDAR Sensor Fusion

LiDAR-based simultaneous multi-object tracking and static mapping in nearshore scenario

Collaborative Perception Method Based on Multisensor Fusion

Real-time Tracking and Berthing Aid System with Occlusion Handling Based on LiDAR

Ship Detection Based on LiDAR and Visual Information Fusion

Autonomous navigation and collision prediction of port channel based on computer vision and lidar

Ship Recognition and Tracking System for Intelligent Ship Based on Deep Learning Framework

Research on Active Intelligent Perception Technology of Vessel Situation Based on Multisensor Fusion

A Robust Method for Multi Object Tracking in Autonomous Ship Navigation Systems

Enhancing 3D object detection through multi-modal fusion for cooperative perception

Identity Recognition on Waterways: a Novel Ship Information Tracking Method Based on Multimodal Data

Video-Based Detection Infrastructure Enhancement for Automated Ship Recognition and Behavior Analysis

Research on Fusion Method of Lidar and Visual Image Based on Surface Vehicle

Locally Oriented Scene Complexity Analysis Real-Time Ocean Ship Detection from Optical Remote Sensing Images

A Multi-feature Combination Method for Tracking of Marine Ships

Spatio-Temporal Fusion of LiDAR and Camera Data for Omnidirectional Depth Perception

Intelligent Edge-Enabled Efficient Multi-Source Data Fusion for Autonomous Surface Vehicles in Maritime Internet of Things