Abstract:Abstract With the rapid development of unmanned aerial vehicle (UAV) technology, there are more and more fields of UAV application. This research mainly discusses the UAV patrol path planning based on machine vision and multi-sensor fusion. This article studies how to apply ultrasonic, a classic ranging sensor, to obstacle avoidance of UAVs. The designed ultrasonic obstacle avoidance system is a complete set of hardware and software systems. The hardware part consists of a forward ultrasonic module and a central signal processing module. Among them, a single-axis stabilization gimbal is designed for the forward ultrasonic module, which decouples the attitude angle of the UAV and the pitch detection angle of the ultrasonic sensor. In the central signal processing module, Kalman filtering is performed on the ultrasonic data in the four directions of front, rear, left, right, and left, and the obstacle avoidance control signal is sent to the flight controller according to the filtered sensor data. At the same time, a human–computer interaction interface is also designed to set various parameters of the obstacle avoidance system. For the route planning method of the tower, the routine steps are used to inspect the tower with a single-circuit line, and the specific targets are the insulator string, the ground wire, and the conductor. In this study, the average statistical result of the straight-line distance of the UAV patrolling 100 m is 99.80 m, and the error is only 0.2%. The fusion obstacle avoidance control method based on machine vision is suitable for the engineering application of UAV perception obstacle avoidance. The obstacle avoidance method adopted in this article can be extended to most flight control platforms, and it is a control method with broad application prospects.

Assess-Ranging-Fuse: Obstacle Detection Based on Stereo Vision Threat Assessment and Ultrasonic Ranging

Autonomous Flights in Dynamic Environments with Onboard Vision

Adaptive Switching Spatial-Temporal Fusion Detection for Remote Flying Drones

Obstacle Detection by ALV Using Two 2D Laser Range Finders

Fusing Stereopsis & Corner Sparse Optical Flow for Real-time Obstacle Avoidance of Unmanned Aerial Vehicle

Autonomous Obstacle Avoidance for UAV Based on Fusion of Radar and Monocular Camera

Autonomous aerial obstacle avoidance using LiDAR sensor fusion

Hybrid Obstacle Avoidance System with Vision and Ultrasonic Sensors for Multi-Rotor MAVs

Low Altitude Sense and Avoid for Muav Based on Stereo Vision

An Active Sense and Avoid System for Flying Robots in Dynamic Environments

Obstacle Avoidance for Outdoor Flight of a Quadrotor Based on Computer Vision

Obstacle Detection and Avoiding of Quadcopter

Fusion of Millimeter Wave Radar and Monocular Vision for Obstacle Detection Based on Rotor-Wing UAV

Stereo-Vision Based Obstacle Avoidance by Finding Safe Region

A real-time dynamic obstacle tracking and mapping system for UAV navigation and collision avoidance with an RGB-D camera

Stereo vision based obstacle avoidance strategy for quadcopter UAV

Monocular Vision-Based Obstacle Detection/Avoidance For Unmanned Aerial Vehicles

Stereo-vision Based Obstacle Motion Information Acquisition Algorithm for Quadrotors

Quadcopter Drone for Vision-Based Autonomous Target Following

UAV Low-Altitude Obstacle Detection Based on the Fusion of LiDAR and Camera

UAV patrol path planning based on machine vision and multi-sensor fusion