VISUAL GUIDED QUALITATIVE NAVIGATION FOR MOBILE ROBOT

Li Gengtian,Guangyou Xu

1993-01-01

ROBOT

Abstract:Summarizing the previous work concerning qualitative navigation for robots,this paper discusses systemat-ically two qualitative positioning methods-sequence region positioning and orientation region positioning,their own properties and mutual relations,while the experiment result is also presented.

What problem does this paper attempt to address?

A Computer Vision for Navigation of Mobile Robots

Zhu Miaoliang,He Zhijun

DOI: https://doi.org/10.1117/12.968257

1987-01-01

Abstract:A computer system which can find the pathway in the robot's sensor field of view with only one camera has been developed. The low level extraction of linear segmentations is performed by edge following algorithm with the local gray level and gradient as heuristics. The symbolic lists which describe the optical and geometric properties of linear segmentations are generated as the output of the low level and submit to the high level. In high level stage a reasoning mechanism whose knowledge base consists of the rules modeling three basic types of pathway segments (non-branch, branch, and end) works on the symbolic lists to make the judgement of which type to be happened in the sensor area. Several parameters such as the exact positions of the pathway can be calculated as the signals for navigation control system. The experiments showed that the system behaved specially well for the existence of noise. shadow. and irregularities of environments.
Improved SLAM and Motor Imagery Based Navigation Control of a Mobile Robot

Jianlong Li,Yiliang Liu,Wang Yuan,Zhijun Li

DOI: https://doi.org/10.1109/ICARM.2018.8610763

2018-01-01

Abstract:A brain-robot interface (BRI) based control system combined with the simultaneous localization and mapping (SLAM) has been developed to achieve the navigation and control of a mobile robot in unknown environments. The BRI system is based on motor imagery(MI), which analyze the human electroencephalograph (EEG) signals through the CSP-based SVM classification algorithm. The SLAM system presented in this paper is improved by combining the RGB-D SLAM, optical flow and deep leaning based Recognition. The optical flow method is used to accurately track the displacement of ORB feature points which consume much less time than calculating the ORB characteristics in each image, while the deep learning based recognition reduce the error caused by detected moving objects, and the error of the localization is minimized through global graph-based nonlinear error optimization. Experiments have been taken by 3 operators and successfully certify the feasibility and efficiency of the whole system.
The Mobile Robot Navigation System Design Based on GPS and GIS

Danghui Yan,Dean Zhao,Huiliang Shen

DOI: https://doi.org/10.4028/www.scientific.net/amm.241-244.1918

2012-01-01

Applied Mechanics and Materials

Abstract:The paper develops an autonomous navigation system with Visual C++ 6.0, combining all-terrain and all-weather mobile robot platform with the high-precision dual-frequency RTK-GPS. The intelligent mobile robot achieves autonomous navigation control. Owing to the four-wheel drive, path tracking is better implemented; Owing to the use of high-precision GPS, position locating is more accurate; Owing to the multithreaded design of the program, real-time requirements of the navigation is better achieved; By the way of map matching of GIS, the path tracking is real-time and the navigation of the robot is more visual and intuitive. The result of experiment shows that this navigation system can meet the requirements of accuracy and real-time and complete the navigation task very well.
Mobile robot obstacle avoidance behavior and navigation control

杜国平,陈圣灵,闫阿宾,卢俊,王月海

DOI: https://doi.org/10.19695/j.cnki.cn12-1369.2012.11.006

2012-01-01

Abstract:Mobile root navigation control based on infrared,ultrasonic and visual is researched in this paper.This article first introduces the working principle of the robot’s infrared and ultrasonic sensors,then presents a navigation control algorithm that extracts the target position after video image binarization Experimental results show that this navigation control combining infrared,ultrasonic sensor and visual recognition has satisfying performance in complex dynamic environment.
Visual Localization of Key Positions for Visually Impaired People

Ruiqi Cheng,Kaiwei Wang,Longqing Lin,Kailun Yang

DOI: https://doi.org/10.1109/icpr.2018.8545141

2018-01-01

Abstract:On the off-the-shelf navigational assistance devices, the localization precision is limited to the signal error of global navigation satellite system (GNSS). During travelling outdoors, the inaccurately localization perplexes visually impaired people, especially at key positions, such as gates, bus stations or intersections. The visual localization is a feasible approach to improving the positioning precision of assistive devices. Using multiple image descriptors, the paper proposes a robust and efficient visual localization algorithm, which takes advantage of priori GNSS signals and multi-modal images to achieve the accurate localization of key positions. In the experiments, we implement the approach on the wearable system and test the performance of visual localization under practical scenarios.
Guided Navigation from Multiple Viewpoints using Qualitative Spatial Reasoning

Danilo Perico,Paulo E. Santos,Reinaldo Bianchi

DOI: https://doi.org/10.1080/13875868.2020.1857386

2020-11-03

Abstract:Navigation is an essential ability for mobile agents to be completely autonomous and able to perform complex actions. However, the problem of navigation for agents with limited (or no) perception of the world, or devoid of a fully defined motion model, has received little attention from research in AI and Robotics. One way to tackle this problem is to use guided navigation, in which other autonomous agents, endowed with perception, can combine their distinct viewpoints to infer the localisation and the appropriate commands to guide a sensory deprived agent through a particular path. Due to the limited knowledge about the physical and perceptual characteristics of the guided agent, this task should be conducted on a level of abstraction allowing the use of a generic motion model, and high-level commands, that can be applied by any type of autonomous agents, including humans. The main task considered in this work is, given a group of autonomous agents perceiving their common environment with their independent, egocentric and local vision sensors, the development and evaluation of algorithms capable of producing a set of high-level commands (involving qualitative directions: e.g. move left, go straight ahead) capable of guiding a sensory deprived robot to a goal location.

Robotics,Artificial Intelligence
Direction-driven Navigation Using Cognitive Map for Mobile Robots

Vui Ann Shim,Bo Tian,Miaolong Yuan,Huajin Tang,Haizhou Li

DOI: https://doi.org/10.1109/iros.2014.6942923

2014-01-01

Abstract:Building an integrated mobile robot that can navigate freely and deliberately in an indoor environment is a challenging task. In this paper, we propose a direction-driven navigation system, in which a mobile robot is instructed to follow the given directions instead of a global path. This is similar to humans when travelling to a target destination by following the directional guidance from someone else. This system consists of two main modules including a grid-based direction planner and a multilayered asymmetrical local navigation module. The directions of movement are computed from a brain-inspired spatial cognitive map using the grid-based direction planner, while the motion of the robot is controlled by the local navigation module. In order to improve the mapping performance using RGB-D input, an improved template comparison method is suggested. The proposed system is implemented in a mobile robot that performs simultaneous localization, mapping, and navigation in a typical office environment. The experimental results indicate that the robot can efficiently navigate to target destinations.
Object-Based Reliable Visual Navigation for Mobile Robot

Fan Wang,Chaofan Zhang,Wen Zhang,Cuiyun Fang,Yingwei Xia,Yong Liu,Hao Dong

DOI: https://doi.org/10.3390/s22062387

IF: 3.9

2022-03-20

Sensors

Abstract:Visual navigation is of vital importance for autonomous mobile robots. Most existing practical perception-aware based visual navigation methods generally require prior-constructed precise metric maps, and learning-based methods rely on large training to improve their generality. To improve the reliability of visual navigation, in this paper, we propose a novel object-level topological visual navigation method. Firstly, a lightweight object-level topological semantic map is constructed to release the dependence on the precise metric map, where the semantic associations between objects are stored via graph memory and topological organization is performed. Then, we propose an object-based heuristic graph search method to select the global topological path with the optimal and shortest characteristics. Furthermore, to reduce the global cumulative error, a global path segmentation strategy is proposed to divide the global topological path on the basis of active visual perception and object guidance. Finally, to achieve adaptive smooth trajectory generation, a Bernstein polynomial-based smooth trajectory refinement method is proposed by transforming trajectory generation into a nonlinear planning problem, achieving smooth multi-segment continuous navigation. Experimental results demonstrate the feasibility and efficiency of our method on both simulation and real-world scenarios. The proposed method also obtains better navigation success rate (SR) and success weighted by inverse path length (SPL) than the state-of-the-art methods.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Robot Vision Navigation's Summarize

Wu Lin

Abstract:Navigation's technique is the core of mobile robot. Mobile robot has many navigation methods. This thesis make a analysis and contrast among all kinds of navigation methods,it gives that because of the development of vision theory and method,and compare to laser,radar and ultrasonic,vision navigation has many advantages,so vision navigation are adopted in many fields. Mobile robot processes the picture in the process of navigation,the bad of real-time always is a very tough problem. The key of solving this problem based on designing a kind of fast picture treatment method.

Engineering,Computer Science
The Optimization of Localization and Navigation for Vision-based Robot

Zhonghan Zhang,Yancao Jiang,Chenyu Zhang,Chun Zhang,Xiangyu Li

DOI: https://doi.org/10.1109/icta48799.2019.9012838

2019-01-01

Abstract:This paper studies the localization and navigation of vision-based robots. In the first step, obtaining the video stream by the monocular camera to get high-quality image information. Then we do a series of preprocessing, such as noise reduction, space conversion, contour extraction, to extract color and shape information. In the second step, getting edge information using a corner detection algorithm combined with weight assignment and constraint, acquiring the current position using the multi-region multi-threshold edge localization algorithm. In particular, for the multi-object locate problem caused by the change of the robot viewing angle, using multi-image stitching matching algorithm to locate, which based on the spatial intermediate point. The third step, we design a number of basic action groups, robot will select the appropriate action group according to the current position and obstacle information, so the robot can pass quickly by bypassing, rolling or crossing over.
Visual Navigation Based on Language Assistance and Memory

Shouguan Xiao,Weiping Fu

DOI: https://doi.org/10.1109/access.2023.3239837

IF: 3.9

2023-02-18

IEEE Access

Abstract:In order to solve outdoor mobile robots' dependence on geographic information systems, and to realize automatic navigation in the face of complex and changeable scenes, we propose a method that selects landmark and adds prompt guidance so that the mobile robot can navigate relying on visual-language and memory. Visual-language can guide the direction of the mobile robot's movement, obeying the annotation of people and according to its memory of the scene, which refers to the strategy of selecting passed-by landmarks for the route and remembering the scene features. When passing it, the agent can ascertain the position and match it to carry out the action. Experiments showed that our proposed method can achieve the purpose of independent navigation without GIS, and is superior to existing methods.

computer science, information systems,telecommunications,engineering, electrical & electronic
Non-metric navigation for mobile robot using optical flow

Yung Siang Liau,Qun Zhang,Yanan Li,Shuzhi Sam Ge

DOI: https://doi.org/10.1109/IROS.2012.6386221

2012-01-01

Abstract:In this paper, we address the problem of non-metric navigation for mobile robot in indoor environment. With pure vision sensors, we tackle the most fundamental problem in autonomous mobile robot navigation - to achieve obstacle avoidance ability in mobile robot. We approach the problem by extracting time-to-contact information using optical flow and motion analysis. Our method is based on flow divergence which contains qualitative depth information of the environment. In addition, we presented a flexible robot heading decision making framework that is able to incorporate higher level navigation task on top of obstacle avoiding behaviour. A state-machine based control scheme is utilized for the coordination of the robot's action defined under a behaviour based design. Through virtual simulation and physical experiments, we demonstrated the effectiveness of our non-metric navigation strategy in unknown environment.
Localization and Navigation System for Indoor Mobile Robot

Yanbaihui Liu

DOI: https://doi.org/10.48550/arXiv.2212.06391

IF: 3.7

2022-12-13

Robotics

Abstract:Visually impaired people usually find it hard to travel independently in many public places such as airports and shopping malls due to the problems of obstacle avoidance and guidance to the desired location. Therefore, in the highly dynamic indoor environment, how to improve indoor navigation robot localization and navigation accuracy so that they guide the visually impaired well becomes a problem. One way is to use visual SLAM. However, typical visual SLAM either assumes a static environment, which may lead to less accurate results in dynamic environments or assumes that the targets are all dynamic and removes all the feature points above, sacrificing computational speed to a large extent with the available computational power. This paper seeks to explore marginal localization and navigation systems for indoor navigation robotics. The proposed system is designed to improve localization and navigation accuracy in highly dynamic environments by identifying and tracking potentially moving objects and using vector field histograms for local path planning and obstacle avoidance. The system has been tested on a public indoor RGB-D dataset, and the results show that the new system improves accuracy and robustness while reducing computation time in highly dynamic indoor scenes.
Hybrid Visual Natural Landmark–based Localization for Indoor Mobile Robots

Xuequn Zhang,Shiqiang Zhu,Zhi Wang,Yuehua Li

DOI: https://doi.org/10.1177/1729881418810143

IF: 1.714

2018-01-01

International Journal of Advanced Robotic Systems

Abstract:Localization is a crucial part of autonomous moving for the indoor mobile robot. The natural features of the ceiling and surrounding environment can serve for position estimation. Based on these natural features, a hybrid visual natural landmarks–based localization method is proposed. We combine the landmarks-based positioning with ceiling-based visual odometry. During the visual odometry, the orientation is computed from the parallel features between the adjacent frames. The position is calculated from the corresponding point features in the two consecutive images using the perspective-n-point method. During the natural landmarks–based localization, the orientation filter is utilized to obtain the global orientation. Then, the feature points are determined by the Compute Unified Device Architecture–based scale-invariant feature transform algorithm. Finally, the position is estimated based on the computed orientation and point features. Various experiments have been conducted to evaluate the effectiveness of the proposed method. The experimental results show that the proposed localization method outperforms other methods in accuracy and efficiency.
User preference-aware navigation for mobile robot in domestic via defined virtual area

Ying Zhang,Cui-Hua Zhang,Xuyang Shao

DOI: https://doi.org/10.1016/j.jnca.2020.102885

IF: 7.574

2021-01-01

Journal of Network and Computer Applications

Abstract:<p>Human-aware robot navigation is the key to facilitate the deployment of mobile robots into human–robot shared environments. Although many efforts have been made in this regard, almost all of the existing works focus on the constraints such as user comfort and social rules, while ignoring to consider user preferences. And it is expected that the mobile robot is able to navigate in the user-desired areas according to user preferences, e.g., navigating at low speed in the bedroom. To this end, this paper studies the problem of allowing users to control the robot's working areas to ensure robot aware navigation based on their preferences. To address the intrusiveness of additional facilities or devices to users, we propose a non-intrusive solution by deploying the virtual areas that are non-physical areas but are respected by the mobile robot while performing navigation tasks. Farther, an interactive interface is developed to support the common (non-expert) users to flexibly define the desired areas and specify the navigation behavior of the robot according to their preferences. The proposed solution is fully evaluated through extensive experiments. Experimental results are presented to demonstrate the validity of our approach, and show that the mobile robot can change its navigation behavior in user-defined areas according to user preferences. Supplementary video can be available at <a href="https://youtu.be/oXtbNavLmMk">https://youtu.be/oXtbNavLmMk</a>.</p>

computer science, interdisciplinary applications, software engineering, hardware & architecture
Using RFID in localization for indoor navigation of mobile robots

Yao Guo,Xuemei Guo,Guoli Wang

DOI: https://doi.org/10.1109/ICMA.2012.6285110

2012-01-01

Abstract:This paper concerns the issue of indoor navigation of mobile robots. Instead of computer vision, the use of RFID is explored in localization for Circular Navigation Guidance(CNG) law, which aims at fulfilling the navigation tasks of target tracking with the specified approaching configurations. Experimental results validate the effectiveness of the proposed method. In comparison to the computer vision based navigation paradigm, our proposed approach has considerable advantages in sensing efficiency and robustness to illumination and environment changes. © 2012 IEEE.
Advanced 3D Navigation System for AGV in Complex Smart Factory Environments

Yiduo Li,Debao Wang,Qipeng Li,Guangtao Cheng,Zhuoran Li,Peiqing Li

DOI: https://doi.org/10.3390/electronics13010130

IF: 2.9

2023-12-29

Electronics

Abstract:The advancement of Industry 4.0 has significantly propelled the widespread application of automated guided vehicle (AGV) systems within smart factories. As the structural diversity and complexity of smart factories escalate, the conventional two-dimensional plan-based navigation systems with fixed routes have become inadequate. Addressing this challenge, we devised a novel mobile robot navigation system encompassing foundational control, map construction positioning, and autonomous navigation functionalities. Initially, employing point cloud matching algorithms facilitated the construction of a three-dimensional point cloud map within indoor environments, subsequently converted into a navigational two-dimensional grid map. Simultaneously, the utilization of a multi-threaded normal distribution transform (NDT) algorithm enabled precise robot localization in three-dimensional settings. Leveraging grid maps and the robot's inherent localization data, the A* algorithm was utilized for global path planning. Moreover, building upon the global path, the timed elastic band (TEB) algorithm was employed to establish a kinematic model, crucial for local obstacle avoidance planning. This research substantiated its findings through simulated experiments and real vehicle deployments: Mobile robots scanned environmental data via laser radar and constructing point clouds and grid maps. This facilitated centimeter-level localization and successful circumvention of static obstacles, while simultaneously charting optimal paths to bypass dynamic hindrances. The devised navigation system demonstrated commendable autonomous navigation capabilities. Experimental evidence showcased satisfactory accuracy in practical applications, with positioning errors of 3.6 cm along the x-axis, 3.3 cm along the y-axis, and 4.3° in orientation. This innovation stands to substantially alleviate the low navigation precision and sluggishness encountered by AGV vehicles within intricate smart factory environments, promising a favorable prospect for practical applications.

engineering, electrical & electronic,computer science, information systems,physics, applied
An Efficient Object Navigation Strategy for Mobile Robots Based on Semantic Information

Yu Guo,Yuanyan Xie,Yue Chen,Xiaojuan Ban,Balqies Sadoun,Mohammad S. Obaidat

DOI: https://doi.org/10.3390/electronics11071136

IF: 2.9

2022-04-02

Electronics

Abstract:In recent years, the rapid development of computer vision makes it possible for mobile robots to be more intelligent. Among the related technologies, the visual SLAM system allows the mobile robot to locate itself, build the map, and provide a navigation strategy to execute follow-up tasks, such as searching for objects in unknown environment according to the observed information. However, most of the existing studies are meant to provide a predefined trajectory for the robot or allow the robot to explore blindly and randomly, which undoubtedly affects the efficiency of the object navigation process and goes against with the idea of “intelligent”. To solve the above problems, an efficient object navigation strategy is proposed in this paper. Firstly, a semantic association model is obtained by using the Mask R-CNN and skip-gram to conduct correlation analysis of common indoor objects. Then, with the help of the above model and ROS framework, an effective object navigation strategy is designed to enable the robot to find the given target efficiently. Finally, the classical ORB-SLAM2 system method is integrated to help the robot build a high usability environment map and find passable paths when moving. Simulation results validated that the proposed strategy can efficiently help the robot to navigate to the object without human intervention.

engineering, electrical & electronic,computer science, information systems,physics, applied
Mobile Robot Indoor Positioning Based on a Combination of Visual and Inertial Sensors

Mingjing Gao,Min Yu,Hang Guo,Yuan Xu

DOI: https://doi.org/10.3390/s19081773

IF: 3.9

2019-04-13

Sensors

Abstract:Multi-sensor integrated navigation technology has been applied to the indoor navigation and positioning of robots. For the problems of a low navigation accuracy and error accumulation, for mobile robots with a single sensor, an indoor mobile robot positioning method based on a visual and inertial sensor combination is presented in this paper. First, the visual sensor (Kinect) is used to obtain the color image and the depth image, and feature matching is performed by the improved scale-invariant feature transform (SIFT) algorithm. Then, the absolute orientation algorithm is used to calculate the rotation matrix and translation vector of a robot in two consecutive frames of images. An inertial measurement unit (IMU) has the advantages of high frequency updating and rapid, accurate positioning, and can compensate for the Kinect speed and lack of precision. Three-dimensional data, such as acceleration, angular velocity, magnetic field strength, and temperature data, can be obtained in real-time with an IMU. The data obtained by the visual sensor is loosely combined with that obtained by the IMU, that is, the differences in the positions and attitudes of the two sensor outputs are optimally combined by the adaptive fade-out extended Kalman filter to estimate the errors. Finally, several experiments show that this method can significantly improve the accuracy of the indoor positioning of the mobile robots based on the visual and inertial sensors.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Map Building for Mobile Robot Based on GQSIM

DUAN Jia-qing,CHEN Zong-hai,LUO Yang-yu,LI Cheng-rong

DOI: https://doi.org/10.3321/j.issn:1001-0920.2009.10.006

2009-01-01

Abstract:According to the uncertainty of sonar information in map building of mobile robot autonomous navigation, a novel method based on grey qualitative simulation(GQSIM) is proposed to interpret and combine sonar information, which is used to process sonar information and build grid map of the environment.First, probability grey number is introduced to describe the uncertainty of sonar information, in order to obtain the probability grey number models of grid cell and sonar.Then, a fusion method is devised to combine new and old information, so that the global map of the enviroment is built.Finally, simulation experiment results show the robustness and accuracy of the proposed method.

VISUAL GUIDED QUALITATIVE NAVIGATION FOR MOBILE ROBOT

A Computer Vision for Navigation of Mobile Robots

Improved SLAM and Motor Imagery Based Navigation Control of a Mobile Robot

The Mobile Robot Navigation System Design Based on GPS and GIS

Mobile robot obstacle avoidance behavior and navigation control

Visual Localization of Key Positions for Visually Impaired People

Guided Navigation from Multiple Viewpoints using Qualitative Spatial Reasoning

Direction-driven Navigation Using Cognitive Map for Mobile Robots

Object-Based Reliable Visual Navigation for Mobile Robot

Robot Vision Navigation's Summarize

The Optimization of Localization and Navigation for Vision-based Robot

Visual Navigation Based on Language Assistance and Memory

Non-metric navigation for mobile robot using optical flow

Localization and Navigation System for Indoor Mobile Robot

Hybrid Visual Natural Landmark–based Localization for Indoor Mobile Robots

User preference-aware navigation for mobile robot in domestic via defined virtual area

Using RFID in localization for indoor navigation of mobile robots

Advanced 3D Navigation System for AGV in Complex Smart Factory Environments

An Efficient Object Navigation Strategy for Mobile Robots Based on Semantic Information

Mobile Robot Indoor Positioning Based on a Combination of Visual and Inertial Sensors

Map Building for Mobile Robot Based on GQSIM