Abstract:Abstract. In order to improve usability and safety, modern unmanned aerial vehicles (UAVs) are equipped with sensors to monitor the environment, such as laser-scanners and cameras. One important aspect in this monitoring process is to detect obstacles in the flight path in order to avoid collisions. Since a large number of consumer UAVs suffer from tight weight and power constraints, our work focuses on obstacle avoidance based on a lightweight stereo camera setup. We use disparity maps, which are computed from the camera images, to locate obstacles and to automatically steer the UAV around them. For disparity map computation we optimize the well-known semi-global matching (SGM) approach for the deployment on an embedded FPGA. The disparity maps are then converted into simpler representations, the so called U-/V-Maps, which are used for obstacle detection. Obstacle avoidance is based on a reactive approach which finds the shortest path around the obstacles as soon as they have a critical distance to the UAV. One of the fundamental goals of our work was the reduction of development costs by closing the gap between application development and hardware optimization. Hence, we aimed at using high-level synthesis (HLS) for porting our algorithms, which are written in C/C++, to the embedded FPGA. We evaluated our implementation of the disparity estimation on the KITTI Stereo 2015 benchmark. The integrity of the overall realtime reactive obstacle avoidance algorithm has been evaluated by using Hardware-in-the-Loop testing in conjunction with two flight simulators.

Real time obstacle detection for AGV navigation using multi-baseline stereo

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Monocular Vision Based Obstacle Detection for Robot Navigation in Unstructured Environment

Stereo Vision Based SLAM in Outdoor Environments

Long-Range Traversability Awareness and Low-Lying Obstacle Negotiation with RealSense for the Visually Impaired

Obstacle Detection by ALV Using Two 2D Laser Range Finders

A ground and obstacle detection algorithm for the visually impaired

A Real-time Multi-lane Detection Approach Using Features Geometric Uncertainty and Stereo Vision

Stereo Visual Localization, Sensing and Perception for Fast-moving Unmanned Ground Vehicles

A Single Camera Stereo System for Obstacle Detection

Vision-Based Real-Time Obstacles Detection and Tracking for Autonomous Vehicle Guidance

Stereo-Vision Based Obstacle Avoidance by Finding Safe Region

Research on Stereo Vision Based Obstacle Detection Algorithm

REAL-TIME ON-BOARD OBSTACLE AVOIDANCE FOR UAVS BASED ON EMBEDDED STEREO VISION

Vision system with dual CCD cameras for automatic guided vehicle

Gaussian-Process-Based Real-Time Ground Segmentation for Autonomous Land Vehicles

Stereo vision based negative obstacle detection

Robust Stereo Visual SLAM for Dynamic Environments With Moving Object

A Real-Time Obstacle Detection Algorithm for the Visually Impaired Using Binocular Camera

Enhancing Automated Guided Vehicle Navigation with Multi-Sensor Fusion and Algorithmic Optimization

Real-time obstacle detection by stereo vision and ultrasonic data fusion