Abstract:Underwater target localization uses real-time sensory measurements to estimate the position of underwater objects of interest, providing critical feedback information for underwater robots. While acoustic sensing is the most acknowledged method in underwater robots and possibly the only effective approach for long-range underwater target localization, such a sensing modality generally suffers from low resolution, high cost and high energy consumption, thus leading to a mediocre performance when applied to close-range underwater target localization. On the other hand, optical sensing has attracted increasing attention in the underwater robotics community for its advantages of high resolution and low cost, holding a great potential particularly in close-range underwater target localization. However, most existing studies in underwater optical sensing are restricted to specific types of targets due to the limited training data available. In addition, these studies typically focus on the design of estimation algorithms and ignore the influence of illumination conditions on the sensing performance, thus hindering wider applications in the real world. To address the aforementioned issues, this paper proposes a novel target localization method that assimilates both optical and acoustic sensory measurements to estimate the 3D positions of close-range underwater targets. A test platform with controllable illumination conditions is designed and developed to experimentally investigate the proposed multi-modal sensing approach. A large vision model is applied to process the optical imaging measurements, eliminating the requirement for training data acquisition, thus significantly expanding the scope of potential applications. Extensive experiments are conducted, the results of which validate the effectiveness of the proposed underwater target localization method.

Development and Research of a Multi-Medium Motion Capture System for Underwater Intelligent Agents

Online Fish Tracking with Portable Smart Device for Ocean Observatory Network

Fish Keypoints Detection for Ecology Monitoring Based on Underwater Visual Intelligence

A Low Cost Visual Positioning System for Small Scale Tracking Experiments on Underwater Vehicles

Online 3D Behavioral Tracking of Aquatic Model Organism with a Dual-Camera System

Motion Capture and Retargeting of Fish by Monocular Camera

Real-Time Underwater Fish Tracking Based on Adaptive Multi-Appearance Model

Development of a Multimedia Videogrammetric Technique in Underwater Dynamic Monitoring

Visual Detection And Feature Recognition Of Underwater Target Using A Novel Model-Based Method

Semi-practicality Simulation of Underwater Multi-target Tracking System

Research on the Method of Underwater Swimming Motion Capture

Localization Method for Underwater Robot Swarms Based on Enhanced Visual Markers

A Novel Visual Measurement Method for Three-Dimensional Trajectory of Underwater Moving Objects Based on Deep Learning

Swarm Motion of Underwater Robots Based on Local Visual Perception

Design and Implementation of a 3D Undersea Camera System

Cooperative Localization and Evaluation of Small-Scaled Spherical Underwater Robots

Design, Implementation and Evaluation of an External Pose-Tracking System for Underwater Cameras

A Visual–Inertial Pressure Fusion-Based Underwater Simultaneous Localization and Mapping System

A Multi-Modal Approach Based on Large Vision Model for Close-Range Underwater Target Localization

Real-time Fish Animation Generation by Monocular Camera

Automated Planar Tracking the Waving Bodies of Multiple Zebrafish Swimming in Shallow Water