Abstract:In this paper, we focus on the safety supervision of inland vessels. This paper especially aims at studying the vessel target detection and dynamic tracking algorithm based on computer vision and the target fusion algorithm based on multisensor. For the vessel video target detection and tracking, this paper analyzes the current widely used methods and theories. Additionally, facing the application scenarios and characteristics of inland vessels, a comprehensive vessel video target detection algorithm is proposed in this paper. It is combined with a three-frame difference method based on Canny edge detection and a background subtraction method based on mixed Gaussian background modeling. Besides, for the multisensor target fusion, the processing method of laser point cloud data and automatic identification system (AIS) data is analyzed in this paper. Based on the idea of fuzzy mathematics, this paper proposes a method for calculating the fuzzy correlation matrix with normal membership function, which realizes the fusion of vessel track features of laser point cloud data and AIS data under dynamic video correction. Finally, through this method, a set of vessel situation active intelligent perception systems based on multisensor fusion was developed. Experiments show that this method has better environmental applicability and detection accuracy than traditional manual detection and any single monitoring method.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to achieve automatic detection and tracking of ship targets in intelligent inland - river ship supervision, and combine multi - sensor data fusion analysis to improve supervision accuracy and achieve intuitive expression of ship supervision information. Specifically, the paper focuses on: 1. **Ship video target detection and tracking**: How to accurately and effectively extract ship targets from existing videos and achieve automatic detection and tracking of ship video targets. 2. **Multi - sensor data fusion**: How to effectively fuse laser point cloud data and Automatic Identification System (AIS) data to improve the environmental adaptability and detection accuracy of the supervision system. ### Main research contents 1. **Ship video target detection algorithm**: - A ship video target detection algorithm combining the three - frame difference method (based on Canny edge detection) and the background subtraction method (based on Gaussian mixture background modeling) is proposed. - The video image sequence is pre - processed by histogram equalization and median filtering to improve the accuracy of target extraction. - The Canny edge detection is used to obtain image edge information, and a logical AND operation is performed with the contour information obtained by the three - frame difference method to obtain complete information of moving targets. - The background image is obtained by the Gaussian mixture background modeling method to further improve the accuracy of background subtraction. 2. **Multi - sensor target fusion algorithm**: - The processing methods of laser point cloud data and AIS data are analyzed. - Based on the idea of fuzzy mathematics, a method of calculating the fuzzy correlation matrix using the normal membership function is proposed, which realizes the ship trajectory feature fusion of laser point cloud data and AIS data under dynamic video correction. - By establishing a fuzzy correlation matrix, it is judged whether two trajectories from multiple systems represent the same ship target. ### Experimental verification The paper has developed a ship situation - active intelligent perception system based on multi - sensor fusion, which can achieve the following functions: - Ship contour recognition - Ship freeboard measurement - Ship position and speed supervision - Ship traffic statistics - Automatic illegal evidence collection for ships entering and leaving the jurisdiction area The system uses a variety of on - site sensor devices such as laser scanners, CCTV, and AIS to achieve high - precision, all - weather, and uninterrupted automatic supervision and statistical analysis. ### Conclusion The ship video target detection and multi - sensor data fusion methods proposed in the paper effectively improve the environmental adaptability and detection accuracy of the intelligent inland - river ship supervision system, and provide strong technical support for the safety supervision of inland - river ships.

Research on Active Intelligent Perception Technology of Vessel Situation Based on Multisensor Fusion

A New Multi-Sensor Fusion Approach for Integrated Ship Motion Perception in Inland Waterways

Improving Maritime Traffic Surveillance in Inland Waterways Using the Robust Fusion of AIS and Visual Data

Intelligent Maritime Surveillance Framework Driven by Fusion of Camera-Based Vessel Detection and AIS Data

Practical Moving Target Detection in Maritime Environments Using Fuzzy Multi-sensor Data Fusion

Asynchronous Trajectory Matching-Based Multimodal Maritime Data Fusion for Vessel Traffic Surveillance in Inland Waterways

Intelligent Edge-Enabled Efficient Multi-Source Data Fusion for Autonomous Surface Vehicles in Maritime Internet of Things

Multi-modal Information Fusion for LiDAR-based 3D Object Detection Framework

Research on Surface Environment Perception Via Camera-LiDAR Sensor Fusion

Edge Computing-Enabled Multi-Sensor Data Fusion for Intelligent Surveillance in Maritime Transportation Systems

Vessel Trajectory Tracking and Intention Recognition Algorithm under Multi-Source Satellite Situation

Vessel detection and classification fusing radar and vision data

Multi-Source Remote Sensing Image Fusion for Ship Target Detection and Recognition

Video-Based Detection Infrastructure Enhancement for Automated Ship Recognition and Behavior Analysis

A Hybrid Method for Inland Ship Recognition Using Marine Radar and Closed-Circuit Television

A Robust Assessment of Inland Waterway Collision Risk Based on AIS and Visual Data Fusion

A Multi-modality Sensor System for Unmanned Surface Vehicle

The Key Technologies of Marine Multiobjective Ship Monitoring and Tracking Based on Computer Vision

Association of AIS and Radar Data in Intelligent Navigation in Inland Waterways Based on Trajectory Characteristics

Robust Infrared Maritime Target Detection Based on Visual Attention and Spatiotemporal Filtering

Point Association Analysis of Vessel Target Detection with SAR, HFSWR and AIS