Abstract:Video-based detection infrastructure is crucial for promoting connected and autonomous shipping (CAS) development, which provides critical on-site traffic data for maritime participants. Ship behavior analysis, one of the fundamental tasks for fulfilling smart video-based detection infrastructure, has become an active topic in the CAS community. Previous studies focused on ship behavior analysis by exploring spatial-temporal information from automatic identification system (AIS) data, and less attention was paid to maritime surveillance videos. To bridge the gap, we proposed an ensemble you only look once (YOLO) framework for ship behavior analysis. First, we employed the convolutional neural network in the YOLO model to extract multi-scaled ship features from the input ship images. Second, the proposed framework generated many bounding boxes (i.e., potential ship positions) based on the object confidence level. Third, we suppressed the background bounding box interferences, and determined ship detection results with intersection over union (IOU) criterion, and thus obtained ship positions in each ship image. Fourth, we analyzed spatial-temporal ship behavior in consecutive maritime images based on kinematic ship information. The experimental results have shown that ships are accurately detected (i.e., both of the average recall and precision rate were higher than 90%) and the historical ship behaviors are successfully recognized. The proposed framework can be adaptively deployed in the connected and autonomous vehicle detection system in the automated terminal for the purpose of exploring the coupled interactions between traffic flow variation and heterogeneous detection infrastructures, and thus enhance terminal traffic network capacity and safety.

Pose-relay Videometric Method and Ship Deformation Measurement System with Camera-Series

Research Of Noncontact Monitoring System Based On 3d Reconstruction Method In Shipbuilding Processes

Pose Alignment of Aircraft Structures with Distance Sensors and CCD Cameras

A non-contact measurement method of ship block using image-based 3D reconstruction technology

A New Inertial Measurement Method Of Ship Dynamic Deformation

Towards Stereo Vision Slam Based Pose Estimation For Ship Hull Inspection

Visual-Inertial Fusion-Based Five-Degree-of-Freedom Motion Measurement System for Vessel-Mounted Cranes

New technology of ship distortion measurement

A New Method Based on Photogrammetry for Hull'S Deformation Measurement and Its Accuracy Analysis

Stereo vision based systems for sea-state measurement and floating structures monitoring

IMU Based Deformation Estimation about the Deck of Large Ship

Optical and Dynamic Measuring System for Movement Data of Aircraft Structural Parts

A Novel Visual Measurement Method for Three-Dimensional Trajectory of Underwater Moving Objects Based on Deep Learning

Real-Time Digital Twin of Ship Structure Deformation Field Based on the Inverse Finite Element Method

Robust Pose Estimation for Ship Block Assembly Feature Based on Large-Scale Scanning

Research Of 3d-Compensating Robot Cutting System For Deformed Shipbuilding Profiles

Video-Based Detection Infrastructure Enhancement for Automated Ship Recognition and Behavior Analysis

A hull deformation measurement method based on fiber optic gyro angular rate matching in complex sea conditions

Research an Online Monitoring Method of Propulsion Shafting Alignment Adapting to Hull Deformation

Real-time geometry identification of moving ships by computer vision techniques in bridge area

A Ship Ranging and Positioning System Based on Binocular Vision Technology