Study On Control Structure For The Automated Guided Vehicle Base On Visual Navigation

shoutao li,wei wei,rongben wang

DOI: https://doi.org/10.1109/ccdc.2015.7162344

2015-01-01

Abstract:This paper presents a control structure for the visual navigation automated guided vehicle based on the CCD camera and makes a full introduction about hardware and software. The experimental results show that this structure is feasible.

What problem does this paper attempt to address?

Mobile robot obstacle avoidance behavior and navigation control

杜国平,陈圣灵,闫阿宾,卢俊,王月海

DOI: https://doi.org/10.19695/j.cnki.cn12-1369.2012.11.006

2012-01-01

Abstract:Mobile root navigation control based on infrared,ultrasonic and visual is researched in this paper.This article first introduces the working principle of the robot’s infrared and ultrasonic sensors,then presents a navigation control algorithm that extracts the target position after video image binarization Experimental results show that this navigation control combining infrared,ultrasonic sensor and visual recognition has satisfying performance in complex dynamic environment.
A Computer Vision for Navigation of Mobile Robots

Zhu Miaoliang,He Zhijun

DOI: https://doi.org/10.1117/12.968257

1987-01-01

Abstract:A computer system which can find the pathway in the robot's sensor field of view with only one camera has been developed. The low level extraction of linear segmentations is performed by edge following algorithm with the local gray level and gradient as heuristics. The symbolic lists which describe the optical and geometric properties of linear segmentations are generated as the output of the low level and submit to the high level. In high level stage a reasoning mechanism whose knowledge base consists of the rules modeling three basic types of pathway segments (non-branch, branch, and end) works on the symbolic lists to make the judgement of which type to be happened in the sensor area. Several parameters such as the exact positions of the pathway can be calculated as the signals for navigation control system. The experiments showed that the system behaved specially well for the existence of noise. shadow. and irregularities of environments.
The Mobile Robot Navigation System Design Based on GPS and GIS

Danghui Yan,Dean Zhao,Huiliang Shen

DOI: https://doi.org/10.4028/www.scientific.net/amm.241-244.1918

2012-01-01

Applied Mechanics and Materials

Abstract:The paper develops an autonomous navigation system with Visual C++ 6.0, combining all-terrain and all-weather mobile robot platform with the high-precision dual-frequency RTK-GPS. The intelligent mobile robot achieves autonomous navigation control. Owing to the four-wheel drive, path tracking is better implemented; Owing to the use of high-precision GPS, position locating is more accurate; Owing to the multithreaded design of the program, real-time requirements of the navigation is better achieved; By the way of map matching of GIS, the path tracking is real-time and the navigation of the robot is more visual and intuitive. The result of experiment shows that this navigation system can meet the requirements of accuracy and real-time and complete the navigation task very well.
Path Planning for Automated Navigation in Virtual Environment

Hongbing Shi,Yibin Zhang,Ruofeng Tong,Jinxiang Dong

DOI: https://doi.org/10.3321/j.issn:1003-9775.2006.04.021

2006-01-01

Abstract:Motion planning algorithm for robotics is applied to find the approximate path, and the final one is obtained through several times of optimization. Instead of directly controlling the position and viewing direction, users only need to specify the goal position, and the system itself will complete the navigation. The camera is collision-free from surrounding objects during the navigation process, and the presentation on screen is optimized by several basic aesthetic rules. Based on hierarchical decomposition of scenes and introducing efficient ways of path smoothing and viewing orientation planning, the whole planning process is fast and effective.
Terminal navigation and control for docking an underactuated autonomous underwater vehicle

bo li,yuanxin xu,chenzhan liu,shuangshuang fan,wen xu

DOI: https://doi.org/10.1109/CYBER.2015.7287904

2015-01-01

Abstract:Robust and accurate vehicle guidance and control are critically important for docking an underactuated Autonomous Underwater Vehicle (AUV) to a small and simple docking structure. In this work, only one high-power LED light is used for AUV visual guidance. Without the distance information, we estimate the relative heading, and control the AUV to track the docking station axis line with constant heading. The method is then modified to cope with the environment with current. Finally, the traditional PID control is used for yaw control. Through simulation and preliminary pool experiment, the performance of the navigation and control system are verified.
An Integrated Vision System for ALV Navigation.

XQ Ye,JL Liu,WK Gu

DOI: https://doi.org/10.1142/s0218001400000593

IF: 1.261

2000-01-01

International Journal of Pattern Recognition and Artificial Intelligence

Abstract:In this paper an integrated vision system for autonomous land vehicle is described. The vision system includes 2D and 3D vision modules and information fusion module. The task of 2D vision is to provide the physical and geometry information of road, and the task of 3D vision system is to detect the obstacles in the surrounding. Fusion module combines 2D and 3D information to generate a feasible region provided for vehicle navigation.
A Hardware Structure Design for Intelligent Micro-vehicles Based on Visual Sensors

ZENG Jia-wei,JIANG Yong-heng,LU Geng,WANG Jing-chun,BI Jian-quan

2012-01-01

Abstract:To cooperate the project 'cognitive computing of visual and auditory information' supported by NSFC,it introduces a kind of hardware structure of intelligent micro-vehicles based on visual sensors,as a platform for the development of the technology of autonomous driving in the high-similarity micro-environment of urban roads.Firstly,offer a brief overview of the development of intelligent vehicles.Then according to the application background and the requirements for performance,directed by the idea of modular design,put forward a hardware structure of micro-vehicles and elaborate on the principles of design for each individual part.This structure puts the visual sensors at the key place of environment cognition,which is quite different from the traditional design path.The tests and exhibition demonstrate this structure is reasonable-constructed,well-performed and satisfactory for this project as the physical platform.
An Automatic Control System for Ratbot Navigation

Yanming Zhang,Chao Sun,Nenggan Zheng,Shaomin Zhang,Jiyan Lin,Weidong Chen,Xiaoxiang Zheng

DOI: https://doi.org/10.1109/greencom-cpscom.2010.168

2010-01-01

Abstract:In this paper, we present a novel intelligent control system for rat navigation based on video tracking and state machine techniques. And we demonstrate the automatic navigation of a rat to follow a preset course. The system consists of these components: (1) a wireless backpack stimulator comprised of stimulating circuit, control processor and bluetooth transceivers, (2) a video camera device capturing the rat's movement, (3) a state machine based control program generating navigation commands automatically. The main contribution of this work is the intelligent control system for navigating a rat accurately and automatically in a comparatively narrow space. Experiment results show that the system is stable and practical.
DIGITAL IMAGE PROCESSING METHODS IN VISUAL NAVIGATION AGV

Wang Shiliu,Wang Yiqiang,Feng Rui,Wan Shihua

DOI: https://doi.org/10.3969/j.issn.1000-386X.2011.06.024

2011-01-01

Abstract:It is an important AGV approach to guide the AGV with computer visual technology.The method obtains road image information through cameras and processes it to get road parameters to guide AGV navigations.Most existing visual navigation algorithms are too complicated to satisfy real time demands in actual applications.The paper proposes a visual navigation approach based on road parameter identification,which identifies roads as curving parameters to be modified together with the combination of predictions.Under the premise of promising its precision,the efficiency of the algorithm is significantly promoted.Theoretical analysis and experimental results demonstrate that the approach bears such characteristics as high identification resolution,speedy execution and practicality.
An Intelligent Navigation Control Approach for Autonomous Unmanned Vehicles via Deep Learning-Enhanced Visual SLAM Framework

Lu Chen,Yapeng Liu,Panpan Dong,Jianwei Liang,Aibing Wang

DOI: https://doi.org/10.1109/access.2023.3326754

IF: 3.9

2023-11-03

IEEE Access

Abstract:For autonomous unmanned vehicles (AUVs), navigation control is an essential concern in academia. Conventionally, existing research works dealt with this issue by resorting to the "Simultaneous Localization and Mapping" (SLAM) technology. Although many SLAM-based approaches had been proposed in recent years, they could not mostly perceive semantic characteristics from dynamic visual scenarios. To deal with this challenge, this paper proposes a navigation control approach for AUVs via a deep learning-enhanced visual SLAM framework. Firstly, the commonly used coordinate system in the motion of AUVs is analyzed, and a mathematical description of the circular arc motion of AUVs is formulated. Then, an up-convex curve model is adopted to realize high-accuracy detection of the bilateral lane lines. On the foundation, a yaw angle guidance-based imitation learning framework is utilized to realize navigation control. This well facilitates the analyzing the causal relationship between scenarios and decisions. Some experiments are conducted by simulating real-world urban road scenes, to testify the efficiency of the navigation control for AUVs. The results show that navigation accuracy can be improved by about 5%.

computer science, information systems,telecommunications,engineering, electrical & electronic
Technology and Application of Intelligent Driving Based on Visual Perception

Xinyu Zhang,Hongbo Gao,Guotao Xie,Buyun Gao,Deyi Li

DOI: https://doi.org/10.1049/trit.2017.0015

IF: 7.985

2017-01-01

CAAI Transactions on Intelligence Technology

Abstract:The camera is one of the important sensors to realise the intelligent driving environment. It can realise lane detection and tracking, obstacle detection, traffic sign detection, identification and discrimination and visual simultaneous localisation and mapping. The visual sensor model, quantity and installation location are different on different intelligent driving hardware experimental platform as well as the visual sensor information processing module, thus a number of intelligent driving system software modules and interfaces are different. In this study, the software architecture of the autonomous vehicle based on the driving brain is used to adapt to different types of visual sensors. The target segment is extracted by the image segmentation algorithm, and then the segmentation of the region of interest is carried out. According to the input feature calculation results, the obstacle search is done in the second segmentation region, the output of the accessible road area. As driving information is complete, the authors will increase or reduce one or more visual sensors, change the visual sensor model or installation location, which will no longer directly affect the intelligent driving decision, they make the multi-vision sensors adapted to the requirements of different intelligent driving hardware test platforms.
Study on automated guided vehicle navigation method with external computer vision

Zhao Yingbo,Xiu Shichao,Hong Yuan,Bu Xinyu

DOI: https://doi.org/10.1177/09544054241245476

2024-04-23

Proceedings of the Institution of Mechanical Engineers Part B Journal of Engineering Manufacture

Abstract:Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture, Ahead of Print. Automated guided vehicle (AGV) navigation is extensively used in industrial manufacturing. Existing AGV navigation methods have high accuracy but usually require expensive positioning sensors. This paper proposes a novel method for AGV navigation based on external computer vision (NECV). No matter how many AGVs are in the workshop, the proposed NECV method uses only an external camera mounted on the top of the roof to detect and track AGVs, and all the AGVs don't need to be equipped with any positioning sensors. Because there is no need to equip positioning sensors on AGVs, and also don't need to arrange positioning signs, NECV significantly reduces the positioning cost of navigation. YOLOv8 was selected as the detector for NECV, and the training was completed using a prepared dataset. We improved the structure of the StrongSORT algorithm and used it as the tracker. The improved StrongSORT algorithm is the core of NECV. The imaging coordinates of the AGVs are detected by the detector, transformed into global coordinates through inverse perspective mapping, and passed to the master console. Experimental results indicated that the NECV detection deviation q of the AGV and the experimental accuracy metrics of the NECV after compensating q were considerably improved, close to those of the popular Quick Response (QR) code navigation method. Statistically, NECV can reduce the cost of AGV positioning detection by 90%.

engineering, mechanical, manufacturing
Monocular Vision Navigation and Control of Mobile Robot

runchen yan,hong wang,yuzhi yang,huanbing wei,yonggang wang

DOI: https://doi.org/10.1016/j.aasri.2012.11.112

2012-01-01

AASRI Procedia

Abstract:In this paper, we implement a monocular vision navigation system on a mobile robot which can travel in known outdoor environment. The system uses 5 different sensors on the robot which are monocular color camera, laser radar, sonar, gyroscopes and optical encoder. And the robot can cruise independently in known continuous structured and unstructured road environment mainly through the vision navigation module. There are road recognition module, signs recognition module, stop line recognition module, zebra crossing recognition module, obstacle sensing module, control module and communication module. The system utilizes multi-threading technology to collaborate different modules in the same control cycle and automatic state machine to switch different control modes. Experimental results show that the robot can accomplish autonomous cruise task on the predetermined route and operate stably when it is in a good lighting conditions. (C) 2012 The Authors. Published by Elsevier Ltd. Selection and/or peer review under responsibility of American Applied Science Research Institute
Vision Based Control for Autonomous Vehicle Navigation

Mo-Yuen Chow,Wesley E. Snyder,Rachana Ashok Gupta

2010-01-01

Abstract:"Autonomous vehicles (AV)" are not a new concept. They have been proposed for the long-term goal of having vehicles driving autonomously in an unknown environment for the purpose of human safety, convenience, and ease of life; both in civilian and military applications. In day-to-day life, humans take such navigational capabilities for granted. The human brain achieves all this simultaneously using mostly the sense of vision. That being one of the strong motivation behind vision based control, it is also desirable to use computer vision systems to achieve low cost, low maintenance autonomous vehicle navigation. Recent results from vision research suggest that visual control may now be feasible and will be a major step in conversion of the sensor system required for autonomous guidance to a vision-based one. In this dissertation, we begin the development of the component capabilities in Computer Vision, for autonomous road navigation for the long-term goal of having autonomous vehicles driving in an unknown environment. This dissertation limits itself to the monocular vision component of sensing and navigation control, and treats the path planning components superficially. Unlike other approaches in literature, this research work presents to achieve a complete vision based autonomous vehicle control reducing the drastic dependency on other sensors. Proposed is a vision solution based on accumulator based parametric transforms to detect navigable regions in the urban environment. The novel accumulator voting scheme is called "Parametric Transform for Lanes (PTL)," which enables detection of multiple lanes and variations of lanes such as exits and intersections possible concurrently. Other than being robust to shadows, invariant to color, width and texture of the road, this PTL is based on a control-motivated philosophy. Thus, this dissertation proposes a novel total image-based control solution to the autonomous vehicle control problem, called "Predictive Control in Image Plane (PCIP)." PTL and PCIP together inherently support control for multiple operations; such as lane following, lane changing, turning at intersections, etc. Thus, the proposed predictive control not only reduces the control complexity but also increases the application space for vehicle control. Research work is also extended to other visual components of autonomous driving such as sign detection, car detection, light detection, cross-walk detection etc. A novel clustering method is proposed for car backlight detection, as well as cross-walk detection. The dissertation explains a complete architecture for the autonomous urban driving and talks about integrating all these modules to achieve smooth control of the AV.
THE MULTI-SENSOR FUSION BASED AUTOMATED GUIDED VEHICLE SYSTEM DESIGN AND CONTROL STRATEGY

Wang Yiqiang,Wang Shiliu,Feng Rui

DOI: https://doi.org/10.3969/j.issn.1000-386X.2011.07.015

2011-01-01

Abstract:The automated guided vehicle is of broad application prospect and value in flexible manufacturing,logistics,and automated storage industries.The paper suggests and designs an Automatic Guided Vehicle System on the basis of a number of sensors including CCD camera,RFID sensor,encoder,gyro,sonar and so on.The Controlling objective is achieved by fusing information from various sensor data.A simulation environment is established in the laboratory.A prototype system is developed and tested.Experiment results prove the method improves the real-timeliness and navigating accuracy for AGVS.
Visual Navigation and Obstacle Avoidance Control for Agricultural Robots via LiDAR and Camera

Chongyang Han,Weibin Wu,Xiwen Luo,Jiehao Li

DOI: https://doi.org/10.3390/rs15225402

IF: 5

2023-11-17

Remote Sensing

Abstract:Obstacle avoidance control and navigation in unstructured agricultural environments are key to the safe operation of autonomous robots, especially for agricultural machinery, where cost and stability should be taken into account. In this paper, we designed a navigation and obstacle avoidance system for agricultural robots based on LiDAR and a vision camera. The improved clustering algorithm is used to quickly and accurately analyze the obstacle information collected by LiDAR in real time. Also, the convex hull algorithm is combined with the rotating calipers algorithm to obtain the maximum diameter of the convex polygon of the clustered data. Obstacle avoidance paths and course control methods are developed based on the danger zones of obstacles. Moreover, by performing color space analysis and feature analysis on the complex orchard environment images, the optimal H-component of HSV color space is selected to obtain the ideal vision-guided trajectory images based on mean filtering and corrosion treatment. Finally, the proposed algorithm is integrated into the Three-Wheeled Mobile Differential Robot (TWMDR) platform to carry out obstacle avoidance experiments, and the results show the effectiveness and robustness of the proposed algorithm. The research conclusion can achieve satisfactory results in precise obstacle avoidance and intelligent navigation control of agricultural robots.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Perception, Planning and Control for Self-Driving System Based on On-board Sensors

Yanyan Dai,Suk-Gyu Lee

DOI: https://doi.org/10.1177/1687814020956494

IF: 2.1

2020-09-01

Advances in Mechanical Engineering

Abstract:The autonomous vehicle can recognize and understand environment, self-control, and achieve the driving level of the human driver. To create this kind of system, the following work was carried out: (a) a real time lane detection system is proposed, based on vision system functions, using webcam camera; (b) In order to detect curve lanes, deep learning is applied for lane detection, based on fully Convolutional Neural Network (CNN); (c) The cubic spline interpolation method is used for path generation, based on Global Positioning System (GPS) data, where distance between two adjacent path generation points is same. Compared with the connection method of the cubic polynomial fitting algorithm, the curve fitted path by the cubic spline interpolation method is smoother and more satisfied with the vehicle motion pattern; (d) Based on frenet coordinate frame, optimize trajectory planning method is used to plan safe, easy and comfort trajectory. Compared to the Cartesian coordinate frame, frenet coordinate frame simplifies the solution of road curve fitting problems, especially in the case of complex road environment; (e) Fuzzy sliding mode control method is proposed for vehicle steering control. Finally, the simulation and experiment results are used to prove the effectiveness of the proposed methods.

engineering, mechanical,thermodynamics
The design of smartcar based on ATMEGA2560

Xuan Liang,Shiyong Chen

DOI: https://doi.org/10.1088/1755-1315/632/5/052075

2021-01-01

IOP Conference Series: Earth and Environmental Science

Abstract:Abstract With the development of automotive electronics and robot intelligent technology, intelligent vehicle has become a research hotspot in the field of automatic control. Intelligent vehicle control use automatic control, pattern recognition, sensing technology, electronics, electrical, computer, mechanical and other disciplines. Sensor technology is a very important part in the process of intelligent vehicle automatic driving, Infrared alignment tube is a kind of sensor commonly used in navigation. In this paper, it will first introduce the background of smart car, then the design of smart car software and hardware. After that, the code structure will be introduced. Finally, an intelligent car with the functions of navigation, ranging, automatic parking and searching for beacons will be designed.
Advanced 3D Navigation System for AGV in Complex Smart Factory Environments

Yiduo Li,Debao Wang,Qipeng Li,Guangtao Cheng,Zhuoran Li,Peiqing Li

DOI: https://doi.org/10.3390/electronics13010130

IF: 2.9

2023-12-29

Electronics

Abstract:The advancement of Industry 4.0 has significantly propelled the widespread application of automated guided vehicle (AGV) systems within smart factories. As the structural diversity and complexity of smart factories escalate, the conventional two-dimensional plan-based navigation systems with fixed routes have become inadequate. Addressing this challenge, we devised a novel mobile robot navigation system encompassing foundational control, map construction positioning, and autonomous navigation functionalities. Initially, employing point cloud matching algorithms facilitated the construction of a three-dimensional point cloud map within indoor environments, subsequently converted into a navigational two-dimensional grid map. Simultaneously, the utilization of a multi-threaded normal distribution transform (NDT) algorithm enabled precise robot localization in three-dimensional settings. Leveraging grid maps and the robot's inherent localization data, the A* algorithm was utilized for global path planning. Moreover, building upon the global path, the timed elastic band (TEB) algorithm was employed to establish a kinematic model, crucial for local obstacle avoidance planning. This research substantiated its findings through simulated experiments and real vehicle deployments: Mobile robots scanned environmental data via laser radar and constructing point clouds and grid maps. This facilitated centimeter-level localization and successful circumvention of static obstacles, while simultaneously charting optimal paths to bypass dynamic hindrances. The devised navigation system demonstrated commendable autonomous navigation capabilities. Experimental evidence showcased satisfactory accuracy in practical applications, with positioning errors of 3.6 cm along the x-axis, 3.3 cm along the y-axis, and 4.3° in orientation. This innovation stands to substantially alleviate the low navigation precision and sluggishness encountered by AGV vehicles within intricate smart factory environments, promising a favorable prospect for practical applications.

engineering, electrical & electronic,computer science, information systems,physics, applied
An adaptive fuzzy-sliding lateral control strategy of automated vehicles based on vision navigation

Jinghua Guo,Linhui Li,Keqiang Li,Rongben Wang

DOI: https://doi.org/10.1080/00423114.2013.811789

IF: 3.749

2013-01-01

Vehicle System Dynamics

Abstract:Lateral control is considered to be one of the toughest challenges in the development of automated vehicles due to their features of nonlinearities, parametric uncertainties and external disturbances. In order to overcome these difficulties, an adaptive fuzzy-sliding mode control strategy used for lateral control of vision-based automated vehicles is proposed in this paper. First, a vision algorithm is designed to provide accurate location information of vehicle relative to reference path. Then, an adaptive fuzzy-sliding mode lateral controller is proposed to counteract parametric uncertainties and strong nonlinearities, and the asymptotic stability of the closed-loop lateral control system is proven by the Lyapunov theory. Finally, experimental results indicate that the proposed algorithm can achieve favourable tracking performance, and it has strong robustness.

Study On Control Structure For The Automated Guided Vehicle Base On Visual Navigation

Mobile robot obstacle avoidance behavior and navigation control

A Computer Vision for Navigation of Mobile Robots

The Mobile Robot Navigation System Design Based on GPS and GIS

Path Planning for Automated Navigation in Virtual Environment

Terminal navigation and control for docking an underactuated autonomous underwater vehicle

An Integrated Vision System for ALV Navigation.

A Hardware Structure Design for Intelligent Micro-vehicles Based on Visual Sensors

An Automatic Control System for Ratbot Navigation

DIGITAL IMAGE PROCESSING METHODS IN VISUAL NAVIGATION AGV

An Intelligent Navigation Control Approach for Autonomous Unmanned Vehicles via Deep Learning-Enhanced Visual SLAM Framework

Technology and Application of Intelligent Driving Based on Visual Perception

Study on automated guided vehicle navigation method with external computer vision

Monocular Vision Navigation and Control of Mobile Robot

Vision Based Control for Autonomous Vehicle Navigation

THE MULTI-SENSOR FUSION BASED AUTOMATED GUIDED VEHICLE SYSTEM DESIGN AND CONTROL STRATEGY

Visual Navigation and Obstacle Avoidance Control for Agricultural Robots via LiDAR and Camera

Perception, Planning and Control for Self-Driving System Based on On-board Sensors

The design of smartcar based on ATMEGA2560

Advanced 3D Navigation System for AGV in Complex Smart Factory Environments

An adaptive fuzzy-sliding lateral control strategy of automated vehicles based on vision navigation