Abstract:Structural Health Monitoring, Ahead of Print. Underwater object detection (UOD) is an essential activity in maintaining and monitoring underwater infrastructure, playing an important role in their efficient and low-risk asset management. In underwater environments, sonar, recognized for overcoming the limitations of optical imaging in low-light and turbid conditions, has increasingly gained popularity for UOD. However, due to the low resolution and limited foreground-background contrast in sonar images, existing sonar-based object detection algorithms still face challenges regarding precision and transferability. To solve these challenges, this article proposes an advanced deep learning framework for UOD that uses the data from multibeam forward-looking sonar. The framework is adapted from the network architecture of YOLOv7, one of the state-of-the-art vision-based object detection algorithms, by incorporating unique optimizations in three key aspects: data preprocessing, feature fusion, and loss functions. These improvements are extensively tested on a dedicated public dataset, showing superior object classification performance compared to the selected existing sonar-based methods. Through experiments conducted on an underwater remotely operated vehicle, the proposed framework validates significant enhancements in target classification, localization, and transfer learning capabilities. Since the engineering structures have similar geometric shapes to the objects tested in this study, the proposed framework presents potential applicability to underwater structural inspection and monitoring, and autonomous asset management.

Application of deep learning methods for obstacle classification in ultrasonic surround sensing

Relevance of phase information for object classification in automotive ultrasonic sensing using convolutional neural networks

Convolutional neural network with data augmentation for object classification in automotive ultrasonic sensing.

Deep Learning Algorithms for Complex Pattern Recognition in Ultrasonic Sensors Arrays

Obstacle Detection and Avoidance Using Ultrasonic Sensors in Autonomous Robots

Automated classification of oncoming ground vehicles using acoustic echolocation and supervised machine learning

DeepHybrid: Deep Learning on Automotive Radar Spectra and Reflections for Object Classification

Obstacle Detection Technology for Autonomous Driving Based on Deep Learning

Machine Learning Approach for Obstacle Classification in Automotive Radar

Lidar Based Dynamic Obstacle Detection, Tracking and Recognition Method for Driverless Cars

Machine Learning Based Obstacle Detection for Automatic Train Pairing

A High-Resolution Ultrasonic Environmental Sensing Scheme for Indoor Automated Guided Vehicle Obstacle Avoidance

Object Classification in Automotive Ultrasonic Sensing Using a Convolutional Neural Network

Mono Video-Based AI Corridor for Model-Free Detection of Collision-Relevant Obstacles

Analysis of Obstacle Detection Using Ultrasonic Sensor

A deep learning approach for direction of arrival estimation using automotive-grade ultrasonic sensors

Advanced deep learning framework for underwater object detection with multibeam forward-looking sonar

Deep learning in automated ultrasonic NDE -- developments, axioms and opportunities

Detecting Unexpected Obstacles for Self-Driving Cars: Fusing Deep Learning and Geometric Modeling

Dynamic Obstacle Detection and Representation Approach for Unmanned Vehicles Based on Laser Sensor

Monocular Camera-based Complex Obstacle Avoidance via Efficient Deep Reinforcement Learning