Vision System for Aerial Robot

WANG Wei,LI Ping,HAN Bo

DOI: https://doi.org/10.3969/j.issn.1001-4551.2005.06.014

2005-01-01

Abstract:Vision system is one of the most important parts of the aerial robot for locating and tracking mission. This paper describes a vision system of aerial robot, including hardware and software. In the end, the experimental results show the system effectiveness.

What problem does this paper attempt to address?

&Lt;title>vision System for ALV</title>

Xiuqing Ye,Jilin Liu,Wei Gu

DOI: https://doi.org/10.1117/12.323629

1998-01-01

Abstract:In this paper an integrated vision system for autonomous land vehicle is described. The vision system includes 2D vision, 3D vision, and information fusion. The task of 2D vision is to provide physical information and 3D vision is to detect obstacles in the surrounding. The 2D and 3D information fusion can generate a feasible region provided for vehicle.
Vision System for Mini Unmanned Aerial Vehicles Based on DSP

ZHAO Liang,HAN Bo,LI Ping

DOI: https://doi.org/10.3969/j.issn.1001-4551.2007.02.025

2007-01-01

Abstract:Vision system as an important part of Mini unmanned aerial vehicles(UAV) could complete air-shot,object recognition,vision navigation and many other missions.It was described how to establish a vision system for Mini UAV,considering its own specialty,by using DSP and random hough transform(RHT) separately as hard platform and image recognize arithmetic.Finally the practicability of this vision system by RAPTOR 60 V2 helicopter was verified.
Design and Research on Vision System of Apple Harvesting Robot

Jidong Lv,De-an Zhao,Wei Ji,Yu Chen,Huiliang Shen

DOI: https://doi.org/10.1109/IHMSC.2011.49

2011-01-01

Abstract:The vision system of apple harvesting robot was researched and designed to make it possible for realizing automatic harvesting of apple. The vision system model is studied. The vision system of apple harvesting robot was designed by two aspects, including hardware composition and soft architecture. The VFW method was employed to realize the real-time image acquisition. The recognition of vision system is developed using the combination method of regional growth algorithm and color characteristics. The preliminary orientation of apple target was calculated by finding its centroid. At last, the performance of this version system was evaluated. The results showed that the developed vision system of apple harvesting robot successfully achieved the recognition and orientation of apple target. It was conclude that this version system was effective for realizing the automatic harvesting of apple.
Real-time vision system for a Ping-Pong robot

ZHANG YiFeng,XIONG Rong

DOI: https://doi.org/10.1360/112011-335

2012-01-01

Abstract:As a typical real-time éye-hand' system,the Ping-Pong robot is an ideal platform for high-speed visual perception and fast motor control.It involves high-speed object identification and tracking,trajectory prediction,and fast arm servo,which are also very significant in industrial and military field.This paper proposes a whole solution of real-time vision system for a ping-pong robot,including target recognition algorithm based on feature histogram analysis and fast contour search,modeling algorithm based on dynamics analysis,learning and training algorithms of model parameters,state estimating and trajectory predicting algorithms based on model adaption.To get more robust and accurate prediction under various serving conditions,the proposed method establishes two equivalent forms of the dynamic model of flying ball,the discrete form for state estimation and the continuous form for trajectory prediction.These two forms share the same parameters.According to force analysis,the model parameters are deeply related to ball's state.So we trained the model parameters offline respect to ball's state,instead of setting them to constant values.Thus the model can be adapted accordingly online.Experimental results show the effectiveness and accuracy of the algorithms.It also works very well on Ping-Pong robots to rally with each other and with human.
An Integrated Vision System for ALV Navigation.

XQ Ye,JL Liu,WK Gu

DOI: https://doi.org/10.1142/s0218001400000593

IF: 1.261

2000-01-01

International Journal of Pattern Recognition and Artificial Intelligence

Abstract:In this paper an integrated vision system for autonomous land vehicle is described. The vision system includes 2D and 3D vision modules and information fusion module. The task of 2D vision is to provide the physical and geometry information of road, and the task of 3D vision system is to detect the obstacles in the surrounding. Fusion module combines 2D and 3D information to generate a feasible region provided for vehicle navigation.
Target Detection and Localization for Flapping-Wing Robots Based on Biological Eagle-Eye Vision

Qiang Fu,Shutai Wang,Jin Wang,Xiaoyang Wu,Wei He

DOI: https://doi.org/10.1109/tmech.2024.3424983

2024-01-01

Abstract:In recent years, the development of flapping-wing robots (FWRs) has made rapid progress. However, the vision-based perception system of FWRs is still in its infancy, which seriously limits the application of FWRs in military reconnaissance and civil monitoring. To this end, this article designs an eagle-eye-based vision system for target detection, tracking and localization, which fits well with the perception requirements of FWRs. First, inspired by the double-fovea structure of eagle eye, a two-degree-of-freedom pan-tilt equipped with two different focal length cameras is established. Second, the aerial photography characteristics of FWRs and the lateral inhibition mechanism are employed to improve the accuracy of target detection. Third, based on the information of the two different focal length cameras, a cooperative control method is proposed for the pan-tilt to achieve target tracking and the light gradient boosting machine algorithm is adopted to improve the accuracy of target localization. Finally, flight experiments under various scenarios are conducted by using our self-developed FWR named USTB-Hawk, demonstrating the effectiveness of the proposed vision system.
TIE: an Autonomous and Adaptive Terrestrial-Aerial Quadrotor

Ruibin Zhang,Yuze Wu,Lixian Zhang,Chao Xu,Fei Gao

2021-01-01

Abstract:This letter presents a fully autonomous robot system that possesses both terrestrial and aerial mobility. We firstly develop a lightweight terrestrial-aerial quadrotor that carries sufficient sensing and computing resources. It incorporates both the high mobility of unmanned aerial vehicles and the long endurance of unmanned ground vehicles. An adaptive navigation framework is then proposed that brings complete autonomy to it. In this framework, a hierarchical motion planner is proposed to generate safe and low-power terrestrialaerial trajectories in unknown environments. Moreover, we present a unified motion controller which dynamically adjusts energy consumption in terrestrial locomotion. Extensive realworld experiments and benchmark comparisons validate the proposed system’s robustness and outstanding performance. During the tests, it safely traverses complex environments with terrestrial-aerial integrated mobility, and achieves 7× energy savings in terrestrial locomotion. Finally, we will release our code and hardware configuration as an open-source package.
Development of a Monocular Vision System for Robotic Drilling.

Wei-dong Zhu,Biao Mei,Guo-rui Yan,Ying-lin Ke

DOI: https://doi.org/10.1631/jzus.c1300379

2014-01-01

Abstract:Robotic drilling for aerospace structures demands a high positioning accuracy of the robot, which is usually achieved through error measurement and compensation. In this paper, we report the development of a practical monocular vision system for measurement of the relative error between the drill tool center point（TCP） and the reference hole. First, the principle of relative error measurement with the vision system is explained, followed by a detailed discussion on the hardware components, software components, and system integration. The elliptical contour extraction algorithm is presented for accurate and robust reference hole detection. System calibration is of key importance to the measurement accuracy of a vision system. A new method is proposed for the simultaneous calibration of camera internal parameters and hand-eye relationship with a dedicated calibration board. Extensive measurement experiments have been performed on a robotic drilling system. Experimental results show that the measurement accuracy of the developed vision system is higher than 0.15 mm, which meets the requirement of robotic drilling for aircraft structures.
A Vision-based UAV Tracker Aiming at Aerial Targets

Qiuyu Ren,Zhi Zheng,Li Xu

DOI: https://doi.org/10.1109/ccdc58219.2023.10327392

2023-01-01

Abstract:Autonomous unmanned aerial vehicle (UAV) tracking has been widely used in inspection, rescue, follow-up and many other fields. Compared to ground targets, aerial targets are smaller, more flexible and possess more freedom of motion, which makes the task more challenging. In this paper, we propose a vision-based UAV tracker aiming at aerial targets. Firstly, a lightweight detection model is deployed for target detection and target’s position is estimated taking advantage of detection box information and camera internal parameters. Then, a flexible motion prediction method is proposed followed by an efficient and occlusion-aware front-end path searching approach. Finally, an optimization-based multicopter trajectory planning framework is employed to generate a spatio-temporal optimal trajectory. The experimental results indicate that our tracker achieves great robustness and security in both vertical and horizontal tracking.
A Survey of Computer Vision Applied in Aerial Robotic Vehicles

Yu-chi Liu,Qiong-hai Dai

DOI: https://doi.org/10.1109/opee.2010.5508131

2010-01-01

Abstract:Unmanned Aerial Vehicles (UAVs) are expected to serve as aerial robotic vehicles to perform tasks on their own. Computer vision is applied in UAVs to improve their autonomies both in flight control and perception of environment around them. A survey of researches in such a field is presented. Based on images and videos captured by on-board camera(s), vision measures, such as stereo vision, optical flow fields etc. extract useful features which can be integrated with flight control system to form visual servoing. Three main interests in this field are discussed: visual navigation, aerial surveillance and airborne visual Simultaneous Localization and Mapping (SLAM).
Small Unmanned Aerial Vehicle Visual System for Ground Moving Target Positioning

Zhang, Zhifei,Han, Bo,Li, Ping,Fang, Zhou

DOI: https://doi.org/10.1049/cp.2012.1357

2012-01-01

Abstract:Recently, Small Unmanned Aerial Vehicles (SUAV) are used in a variety of reconnaissance, surveillance, combat applications and so on. Tracking and positioning ground moving targets using a camera mounted on SUAVs has important applications in military and civilian purposes. Although many approaches for a vision-based target positioning system have been developed, most researches are limited to target recognition algorithm or target state estimation. And hardware implementation schemes which can work well with the whole SUAV system are seldom discussed. In order to achieve an available systematic scheme, a complete visual system which incorporates a vision-based ground moving target positioning algorithm is presented in this paper. Experiment results are finally shown and commented. Experiments indicate that the system performs great real time response and high positioning precision.
A Vision System for Autonomous Flight of Micro Helicopter

NA Meng,JIA Pei-fa

DOI: https://doi.org/10.3321/j.issn:1002-8331.2006.30.066

2006-01-01

Computer Engineering and Applications Journal

Abstract:In order to achieve autonomous flight of micro helicopter,a real-time computer vision system is presented in this paper.This vision system consists of on-the-board hardware and customized software algorithm which implements object recognition,feature point extraction,and position estimation.A special target is designed and the recognition algorithm mainly depends on the color information which significantly simplifies and accelerates the vision tasks. Besides,the position parameters can be calculated under the condition of one camera and one frame,through extracting four coplanar feature points.The vision algorithms are processed by Intel Sitsang board on board.Because of the ability of Sitsang,it can process 5-frame images of 160 by 120 in a second.The results of the flight experiments show that the object recognition rate of the vision system reaches 93%,the extracted corner pixels are accurate to within 3 pixels,and the average errors of the position parameters are 8cm,13cm and 6cm.So,the vision system proposed in this paper can commendably assist micro helicopter to achieve autonomous hovering,launching,landing and other flight tasks.
A vision system for landing an unmanned helicopter in a complex environment

Haiqing Shi,Hong Wang

DOI: https://doi.org/10.1117/12.832009

2009-01-01

Abstract:We present a vision-based landing algorithm for an autonomous helicopter under complex environment (there are several suspected targets). The algorithm is integrated with algorithms for visual acquisition, recognition of the target and computing the navigation information. In our algorithm, we use international standard landing mark as our landing target. The experiment results demonstrate that our algorithm has the feature of robustness, accuracy and real time. It can meet the actual flight requirements well: the average processing time of a 640×480 image is less than 40ms; the position error is below 5cm in each axis of translation; the angle error is below 3.5°. Based on the algorithm, we win the champion of the aerial robot competition in the 2008 China robot competition and the RoboCup China open.
Landmark recognition system for mini rotor aerial robot

Ren Qinyuan,Li Ping,Han Bo

DOI: https://doi.org/10.1109/WCICA.2006.1713972

2006-01-01

Abstract:Landmark recognition system is a very important part of mini rotor aerial robot. It recognizes landmarks, and supplies the navigation computer with location information of it. However, mini rotor aerial robots have low pay-load and are small in size. This means that the sensor like radar not fit in with this application, and the small size and low power cost cameras may be the only sensors can be used. In this paper we focus on a landmark recognition system which uses an onboard camera as the sensor. Meanwhile, this paper presents an approach that is applied to real-time recognizing of landmark in video stream. This problem poses several challenges. Landmark in images captured from video stream by moving mini rotor robot vary in shape, size, scale and orientation. Unlike other approaches, this approach is based on classification algorithms. An extended set of haar-like features is used, due to their simplicity. Landmarks are divided into several viewpoint categories according to their poses and each of these categories is processed by a cascade classifier which is trained by the Adaboosting algorithm. In the end, the experimental results verify the effectiveness of the system. © 2006 IEEE.
The Object Recognition and Adaptive Threshold Selection in the Vision System for Landing an Unmanned Aerial Vehicle

Zeng Fucen,Shi Haiqing,Wang Hong

DOI: https://doi.org/10.1109/icinfa.2009.5204904

2009-01-01

Abstract:We present the design and implementation of a vision system for landing an Unmanned Aerial Vehicle (UAV). This vision system consists of the vision detection software and the self-made onboard camera platform. After accomplishing its mission, the UAV would return to the helipad and land on it autonomously and accurately. To achieve more, the head of the UAV must point to the direction which the helipad indicates. The object recognition, the main part of our vision algorithm, includes two parts: the recognition of the identifier ldquoHrdquo which indicates the landing point, and the detection of the triangle which indicates the landing direction. To detect the ldquoHrdquo, we designed a new algorithm based on image registration which turn out to be a fast, robust and computational inexpensive method. And to detect the triangle to confirm the landing direction, we used a method based on Hough Line Detection and Helen formula, which is also very fast and accurate. As a breakthrough of our work, we firstly used an adaptive threshold selection method in such a system to make our algorithm more robust. According to the results of our flight trials, our vision system well performed in this application: the average processing time of a 640times480 image is less than 60 ms, and the average rate of successful target detection is 97.42%. In the 2008 Chinese Robotics Competition, we won the Gold Medal of the aerial robotics group.
Vision System for an Unmanned Helicopter Landing in Complex Environment

Guanlin Wang,Haiqing Shi,Hong Wang,Jihong Zhu

DOI: https://doi.org/10.1109/cisp.2009.5305195

2009-01-01

Abstract:This paper presents a vision-based navigation algorithm for an autonomous helicopter landing in complex environment include appointed landing mark coupled with several similar targets. The vision navigation system is integrated with algorithms of vision detection, target recognition and navigation instruction calculation. The navigation is used for indicating the helicopter to land on the landing mark exactly. In our algorithm, we use international standard landing mark as helicopter landing signal. The experiments results demonstrate that the algorithm has feature of robustness, accuracy and real-time. It meets the actual flight requirements well.
Vision navigation for unmanned helicopter autonomous landing

GuanLin Wang,Haiqing Qing Shi,Hongsheng Tan,Hui Xia,Hong Wang,Jihong Zhu

2009-01-01

Abstract:This paper introduces an unmanned helicopter vision navigation system and algorithm. During the helicopter landing phase, the ground control station detects and identifyies the landing mark from the video shot by helicopter, thus continuously calculating three navigation instructions and sending back to the helicopter. The helicopter can modify the location and yaw angle error until landing on the mark. Therefore, the unmanned helicopter becomes a position servo system based on computer vision navigation. Simulation and real flight experiments indicate that the system has the characteristics of robustness, accuracy and real time. It meets the actual flight requirements of the unmanned helicopter autonomous landing in a complex environment.
Stereo vision based obstacle avoidance strategy for quadcopter UAV

Tingting Wang,Weiwei Zhang,Chen Long,Yang Yu

DOI: https://doi.org/10.1109/CCDC.2018.8407182

2018-06-01

Abstract:This paper presents a visual control method of a small UAV in which binocular stereo vision and ultrasonic system are fused to implement obstacle avoidance strategy. This combination of sensors allows us to get a complete characterization of the environment and describe obstacle avoidance. It means that stereo vision system can detect obstacles around UAV and calculate a new path by RRT-algorithm. The ultrasonic sensor is introduced to compensate for the situations where something may lead to the failure of the obstacle detection. The method presented in this paper can improve the automatic level of the flying control system. Experiments on obstacle avoidance demonstrate the effectiveness of the proposed method and the performance of the UAV platform.

Engineering,Computer Science
Autonomous Vision-Based Aerial Grasping for Rotorcraft Unmanned Aerial Vehicles

Lishan Lin,Yuji Yang,Hui Cheng,Xuechen Chen

DOI: https://doi.org/10.3390/s19153410

2019-08-03

Abstract:Autonomous vision-based aerial grasping is an essential and challenging task for aerial manipulation missions. In this paper, we propose a vision-based aerial grasping system for a Rotorcraft Unmanned Aerial Vehicle (UAV) to grasp a target object. The UAV system is equipped with a monocular camera, a 3-DOF robotic arm with a gripper and a Jetson TK1 computer. Efficient and reliable visual detectors and control laws are crucial for autonomous aerial grasping using limited onboard sensing and computational capabilities. To detect and track the target object in real time, an efficient proposal algorithm is presented to reliably estimate the region of interest (ROI), then a correlation filter-based classifier is developed to track the detected object. Moreover, a support vector regression (SVR)-based grasping position detector is proposed to improve the grasp success rate with high computational efficiency. Using the estimated grasping position and the UAV?Äôs states, novel control laws of the UAV and the robotic arm are proposed to perform aerial grasping. Extensive simulations and outdoor flight experiments have been implemented. The experimental results illustrate that the proposed vision-based aerial grasping system can autonomously and reliably grasp the target object while working entirely onboard.
Research on Quadrotor UAV Target Search System Based on Vision

沈洪梁,程鹏

DOI: https://doi.org/10.3969/j.issn.1001-182X.2015.12.039

2015-01-01

Abstract:This paper mainly studies the target searching and tracking of quadrotor UAV based on vision,and uses O-DROID-XU3 processing board,APM flight control board for underlying flight control core,Logitech c920 camera and low density and high hardness of the mechanical structure building for quadrotor UAV.Through acquisition and processing of the image,search and identifying the target,calculate the relative position of the target,and then control the quardrotor UAV close to the target.The reliability of the whole system is verified by the actual experiment.

Vision System for Aerial Robot

&Lt;title&gt;vision System for ALV&lt;/title&gt;

Vision System for Mini Unmanned Aerial Vehicles Based on DSP

Design and Research on Vision System of Apple Harvesting Robot

Real-time vision system for a Ping-Pong robot

An Integrated Vision System for ALV Navigation.

Target Detection and Localization for Flapping-Wing Robots Based on Biological Eagle-Eye Vision

TIE: an Autonomous and Adaptive Terrestrial-Aerial Quadrotor

Development of a Monocular Vision System for Robotic Drilling.

A Vision-based UAV Tracker Aiming at Aerial Targets

A Survey of Computer Vision Applied in Aerial Robotic Vehicles

Small Unmanned Aerial Vehicle Visual System for Ground Moving Target Positioning

A Vision System for Autonomous Flight of Micro Helicopter

A vision system for landing an unmanned helicopter in a complex environment

Landmark recognition system for mini rotor aerial robot

The Object Recognition and Adaptive Threshold Selection in the Vision System for Landing an Unmanned Aerial Vehicle

Vision System for an Unmanned Helicopter Landing in Complex Environment

Vision navigation for unmanned helicopter autonomous landing

Stereo vision based obstacle avoidance strategy for quadcopter UAV

Autonomous Vision-Based Aerial Grasping for Rotorcraft Unmanned Aerial Vehicles

Research on Quadrotor UAV Target Search System Based on Vision

&Lt;title>vision System for ALV</title>