Abstract:The global positioning system (GPS) has become an indispensable navigation method for field operations with unmanned surface vehicles (USVs) in marine environments. However, GPS may not always be available outdoors because it is vulnerable to natural interference and malicious jamming attacks. Thus, an alternative navigation system is required when the use of GPS is restricted or prohibited. To this end, we present a novel method that utilizes an Unmanned Aerial Vehicle (UAV) to assist in localizing USVs in GNSS-restricted marine environments. In our approach, the UAV flies along the shoreline at a consistent altitude, continuously tracking and detecting the USV using a deep learning-based approach on camera images. Subsequently, triangulation techniques are applied to estimate the USV's position relative to the UAV, utilizing geometric information and datalink range from the UAV. We propose adjusting the UAV's camera angle based on the pixel error between the USV and the image center throughout the localization process to enhance accuracy. Additionally, visual measurements are integrated into an Extended Kalman Filter (EKF) for robust state estimation. To validate our proposed method, we utilize a USV equipped with onboard sensors and a UAV equipped with a camera. A heterogeneous robotic interface is established to facilitate communication between the USV and UAV. We demonstrate the efficacy of our approach through a series of experiments conducted during the ``Muhammad Bin Zayed International Robotic Challenge (MBZIRC-2024)'' in real marine environments, incorporating noisy measurements and ocean disturbances. The successful outcomes indicate the potential of our method to complement GPS for USV navigation.

A Hybrid Vision-Based Method of Encountered Wave Field Measurement for Navigating Surface Vehicles

Image Stitching and Target Perception for Autonomous Underwater Vehicle-collected Side-Scan Sonar Images

Reconstruction of Sand Wave Bathymetry Using Both Satellite Imagery and Multi-Beam Bathymetric Data: A Case Study of the Taiwan Banks

A Depth-Adaptive Waveform Decomposition Method For Airborne Lidar Bathymetry

A Method with Improved Accuracy and Robustness for Object Detection in Wharf Scenarios

Measuring Near-Field Wave Elevation with Monocular Vision Using Self-Supervised Learning Techniques

Sea Wave Directional Distribution Measurement Using Autonomous Underwater Vehicles

Development of a Multimedia Videogrammetric Technique in Underwater Dynamic Monitoring

Stereo vision based systems for sea-state measurement and floating structures monitoring

Measurement Of Spatial-Temporal Waves In The Laboratory Using Computer Vision Technolog

A Millimeter-Wave Radar-Aided Vision Detection Method for Water Surface Small Object Detection

Machine Learning-Based Estimation Of Wave Direction For Unmanned Surface Vehicles

Long-Range Vision-Based UAV-assisted Localization for Unmanned Surface Vehicles

Reconstruction of Large Complex Sand-Wave Bathymetry with Adaptive Partitioning Combining Satellite Imagery and Sparse Multi-Beam Data

Monocular Visual Odometry for an Unmanned Sea-Surface Vehicle

Retrieval of Three-Dimensional Wave Surfaces from X-Band Marine Radar Images Utilizing Enhanced Pix2Pix Model

A Hybrid Method for Predicting the Echo Strength and Statistical Regularity of Warships Coupled with Undulating Sea Surfaces

Real-time Robust Mapping for an Autonomous Surface Vehicle Using an Omnidirectional Camera

An Uncertainty-Aware Hybrid Approach for Sea State Estimation Using Ship Motion Responses

Vision-Based Autonomous Navigation for Unmanned Surface Vessel in Extreme Marine Conditions

Ship Collision Avoidance Navigation Signal Recognition via Vision Sensing and Machine Forecasting