Abstract:This paper presents a novel wearable navigation system for the blind and visually impaired in unknown dynamic environments. Usually, feature-based visual navigation and 3D reconstruction works very well for static environments. In this paper, a dynamic environment is considered, where a moving object is viewed by a moving monocular camera with inertial sensors. A novel method based on feature points from a video sequence is proposed to not only estimate the camera motion itself but also the 3D motion of the moving object so as to infer the depth between the camera and the moving object. Firstly, this video sequence is segmented into static and dynamic areas by two geometry constraints: AGOF-aided homography recovery constraint and epipolar geometry constraint, which is the first key contribution of this paper. Then the motion area related to each moving object can be considered as if a static object were viewed by a “virtual camera”, while the extracted features from the static background are used for estimating the motion of the “real camera”, compared with the “virtual camera”. The second key contribution is to solve the problem of scale ambiguity in monocular camera tracking. The scale is firstly adjusted to be global using a closed form solution with 1-point algorithm and then estimated in metric unit with the help of inertial measurements. After obtaining the motions for the real and virtual camera, the third key contribution is that the 3D moving object's motion can be derived from these two motions, because the virtual camera's motion is actually the combined motion of both the real camera and the moving object. As a result, blind people can avoid collision with moving objects. Finally, we demonstrate the robustness and effectiveness of our proposed method using a series of experimental results.

A New 2-Correspondences Monocular Vision Navigation Method under Planar Motion

Realization of odometry system using monocular vision

Realization of the Monocular Vision Odometry Based on Extracting Keypoints by SIFT in the Navigation System

A Two-Point Spatial Mapping Method for Hybrid Vision Systems

Relative Navigation for Non-cooperative Spacecraft Based on Stereo Vision

A Monocular Vision-based Method for In-plane Moving Target Positioning and Pose Determination

Planar-Based Visual Positioning For A Mobile Robot With Monocular Vision

A novel correspondence searching strategy in multiocular vision

A Motion-based Measurement Method for Monocular Vision System

Visual Odometry Based on Improved Feature Matching and Unscented Kalman Filter

Monocular Vision-Based Navigation Algorithm for Spacecraft Using Dual Quaternion

Wearable navigation system for the blind people in dynamic environments

Monocular Camera Localization in Prior LiDAR Maps with 2D-3D Line Correspondences

A Computer Vision-Based Navigation And Localization Method For Station-Moving Aircraft Transport Platform With Dual Cameras

Navigation system based on machine vision of multiple reference markers

A 2-Point Pose Estimation Algorithm For Monocular Visual Odometry Of Ground Vehicles

A Novel Method to Eliminate Blind Areas for Moving Double Cameras System Based on Biomimetic Eyes

Indoor Visual Navigation Based on Parallels

-Equivariant Graph Planning for Navigation

Correspondence-Free Stereo Vision For The Case Of Arbitrarily-Positioned Cameras

Novel real-time local two dimension map building method based on binocular vision