Abstract:With the rapid development of water transportation, ship safety supervision is facing more severe pressures and challenges. Precise and efficient detection of ship targets is becoming more and more important, which urgently requires intelligent detection methods to ultimately improves shipping management efficiency. However, the surveillance video of waterway transportation is often influenced by fog and rain, which can affect the performance of object detection and reduce the efficiency of management. The current traditional object approaches are hard to handle these problems. In this paper, we propose a novel multi-modal information fusion method to handle multi-object detection in waterway transportation, which introduces the LiDAR (Light Detection And Ranging) dataset to add spatial information and handle the interference of fog and rain. The target ROI (Region Of Interest) point cloud and image data are initially fused in the pre-fusion stage. This phase can efficiently direct the network’s attention to the region with the highest target probability, increasing the target recall rate. The 3D bounding box in the point cloud and 2D bounding boxes in the image retrieved are then fused in the post-fusion stage to improve target precision and enrich target detection information. Finally, using time synchronization and a space transformation matrix, the detection result is transferred to the picture coordinate system to create a ship image target with 3D depth information. This technique overcomes the constraints of single-sensor environment perception, adapts to the detection of ship targets in a variety of situations, and is more precise and robust. The algorithm’s superiority is also demonstrated by the experiments.

Multi-Feature Fusion Based Outdoor Water Hazards Detection

Hazards Detection Multi-Feature Fusion Based Outdoor Water

Daytime Water Hazard Detection Based on Multi-Feature Fusion

Robust Water Hazard Detection for Autonomous Off-Road Navigation

Polarization-based Water Hazards Detection for Autonomous Off-Road Navigation

Water Hazard Detection for Intelligent Vehicle Based on Vision Information

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

A Survey on Water Hazard Detection in the Wild Field

Research on Water Hazards Detection Method Based on A-MSRCR and Improved YOLO.

WaterScenes: A Multi-Task 4D Radar-Camera Fusion Dataset and Benchmarks for Autonomous Driving on Water Surfaces

Dual Stream Cross Domain Feature Fusion for Land-Oceanic Object Detection

Multi-Level Hazard Detection Using a UAV-Mounted Multi-Sensor for Levee Inspection

Multi-modal Information Fusion for LiDAR-based 3D Object Detection Framework

A survey on multi-sensor fusion based obstacle detection for intelligent ground vehicles in off-road environments

Road vehicle detection based on multi-sensor fusion

Research on Surface Environment Perception Via Camera-LiDAR Sensor Fusion

Robust Small Object Detection on the Water Surface Through Fusion of Camera and Millimeter Wave Radar

Intelligent Vision-Enabled Detection of Water-Surface Targets for Video Surveillance in Maritime Transportation

Detection of Dangerous Water Area During UAV Autonomous Landing

Tiny Object Detection Using Multi-Feature Fusion

Vehicle Detection Based on Information Fusion of mmWave Radar and Monocular Vision