Abstract:Visual ranging technology holds great promise in various fields such as unmanned driving and robot navigation. However, complex dynamic environments pose significant challenges to its accuracy and robustness. Existing monocular visual ranging methods are susceptible to scale uncertainty, while binocular visual ranging is sensitive to changes in lighting and texture. To overcome the limitations of single visual ranging, this paper proposes a fusion method for monocular and binocular visual ranging based on an adaptive Unscented Kalman Filter (AUKF). The proposed method first utilizes a monocular camera to estimate the initial distance based on the pixel size, and then employs the triangulation principle with a binocular camera to obtain accurate depth. Building upon this foundation, a probabilistic fusion framework is constructed to dynamically fuse monocular and binocular ranging using the AUKF. The AUKF employs nonlinear recursive filtering to estimate the optimal distance and its uncertainty, and introduces an adaptive noise-adjustment mechanism to dynamically update the observation noise based on fusion residuals, thus suppressing outlier interference. Additionally, an adaptive fusion strategy based on depth hypothesis propagation is designed to autonomously adjust the noise prior of the AUKF by combining current environmental features and historical measurement information, further enhancing the algorithm's adaptability to complex scenes. To validate the effectiveness of the proposed method, comprehensive evaluations were conducted on large-scale public datasets such as KITTI and complex scene data collected in real-world scenarios. The quantitative results demonstrate that the fusion method significantly improves the overall accuracy and stability of visual ranging, reducing the average relative error within an 8 m range by 43.1% and 40.9% compared to monocular and binocular ranging, respectively. Compared to traditional methods, the proposed method significantly enhances ranging accuracy and exhibits stronger robustness against factors such as lighting changes and dynamic targets. The sensitivity analysis further confirmed the effectiveness of the AUKF framework and adaptive noise strategy. In summary, the proposed fusion method effectively combines the advantages of monocular and binocular vision, significantly expanding the application range of visual ranging technology in intelligent driving, robotics, and other fields while ensuring accuracy, robustness, and real-time performance.

What problem does this paper attempt to address?

### The Problem Addressed by the Paper This paper aims to address the issues of accuracy and robustness in visual ranging technology in complex dynamic environments, which are critical for fields such as autonomous driving and robotic navigation. Specifically: 1. **Monocular Visual Ranging**: - Monocular visual ranging methods are susceptible to scale uncertainty, leading to distance drift issues. 2. **Binocular Visual Ranging**: - Binocular visual ranging is sensitive to changes in lighting and texture, making it prone to matching errors in low-texture and repetitive texture scenes. To solve the above problems, the paper proposes a monocular and binocular visual ranging fusion method based on the Adaptive Unscented Kalman Filter (AUKF). The main contributions of this method include: 1. **Unified Probabilistic Fusion Framework**: - A probabilistic fusion framework based on the Unscented Kalman Filter (UKF) is established, which uniformly models the results and uncertainties of monocular and binocular visual ranging, achieving dynamic recursive optimization. 2. **Adaptive Observation Noise Adjustment Mechanism**: - An adaptive observation noise adjustment mechanism is introduced, which dynamically updates the observation covariance matrix of the UKF based on the current fusion residuals, mitigating the impact of outliers. 3. **Adaptive Prior Generation Strategy Based on Depth Hypothesis Propagation**: - An adaptive prior generation strategy based on depth hypothesis propagation is designed, utilizing neural networks to predict depth hypotheses and their uncertainties from monocular image sequences, and dynamically adjusting the state transition noise of the UKF according to environmental features. Through comprehensive evaluations on large-scale public datasets (such as KITTI) and complex datasets in real-world scenarios, this method significantly improves the overall accuracy and stability of visual ranging, reduces the average relative error, and demonstrates high robustness and real-time performance in complex environments.

A Robust Monocular and Binocular Visual Ranging Fusion Method Based on an Adaptive UKF

Accurate and Real-Time 3-D Tracking for the Following Robots by Fusing Vision and Ultrasonar Information

A Robust Localization Approach Using Multi-Sensor Fusion

A Binocular Stereo-Imaging-Perception System with a Wide Field-of-View and Infrared- and Visible Light-Dual-Band Fusion

Fusion of Monocular Vision and Radio-based Ranging for Global Scale Estimation and Drift Mitigation

Accurate and Robust State Estimation via Fusion of Visual-Inertial-UWB with Time Synchronization

Adaptive Zoom Distance Measuring System of Camera Based on the Ranging of Binocular Vision

A Novel Multi-Sensor Nonlinear Tightly-Coupled Framework for Composite Robot Localization and Mapping

Research on a Visual/Ultra-Wideband Tightly Coupled Fusion Localization Algorithm

Scale Estimation and Correction of the Monocular Simultaneous Localization and Mapping (SLAM) Based on Fusion of 1D Laser Range Finder and Vision Data

Robust Fusion of LiDAR and Wide-Angle Camera Data for Autonomous Mobile Robots

A Low-Cost and Robust Multi-Sensor Data Fusion Scheme for Heterogeneous Multi-Robot Cooperative Positioning in Indoor Environments

Improve the Estimation of Monocular Vision 6-DOF Pose Based on the Fusion of Camera and Laser Rangefinder

An Integrated Algorithm Fusing UWB Ranging Positioning and Visual–Inertial Information for Unmanned Vehicles

Unmanned Visual Localization Based on Satellite and Image Fusion

A Multi-Sensor Fusion Framework for Localization Using LiDAR, IMU and RGB-DCamera

MSFusion: Multilayer Sensor Fusion-Based Robust Motion Estimation

Robust Multisensor Fusion for Reliable Mapping and Navigation in Degraded Visual Conditions

RGB-Fusion: Monocular 3D reconstruction with learned depth prediction

Accurate Monocular Visual-inertial SLAM using a Map-assisted EKF Approach

UVIO: Adaptive Kalman Filtering UWB-Aided Visual-Inertial SLAM System for Complex Indoor Environments