Abstract:Using Unmanned Aerial Vehicles (UAVs) to perform high-altitude manipulation tasks beyond just passive visual application can reduce the time, cost, and risk of human workers. Prior research on aerial manipulation has relied on either ground truth state estimate or GPS/total station with some Simultaneous Localization and Mapping (SLAM) algorithms, which may not be practical for many applications close to infrastructure with degraded GPS signal or featureless environments. Visual servo can avoid the need to estimate robot pose. Existing works on visual servo for aerial manipulation either address solely end-effector position control or rely on precise velocity measurement and pre-defined visual visual marker with known pattern. Furthermore, most of previous work used under-actuated UAVs, resulting in complicated mechanical and hence control design for the end-effector. This paper develops an image-based visual servo control strategy for bridge maintenance using a fully-actuated UAV. The main components are (1) a visual line detection and tracking system, (2) a hybrid impedance force and motion control system. Our approach does not rely on either robot pose/velocity estimation from an external localization system or pre-defined visual markers. The complexity of the mechanical system and controller architecture is also minimized due to the fully-actuated nature. Experiments show that the system can effectively execute motion tracking and force holding using only the visual guidance for the bridge painting. To the best of our knowledge, this is one of the first studies on aerial manipulation using visual servo that is capable of achieving both motion and force control without the need of external pose/velocity information or pre-defined visual guidance.

Vision-Based Aircraft Marshalling Recognition and UAM Control Command Generation

Vision-Based In-Flight Collision Avoidance Control Based on Background Subtraction Using Embedded System

Traffic Collisions Early Warning Aided by Small Unmanned Aerial Vehicle Companion

UAV Multi-Dynamic Target Interception: A Hybrid Intelligent Method Using Deep Reinforcement Learning and Fuzzy Logic

A disturbance rejection control for urban air mobility using artificial sensor-based Gaussian process regression

Image-based Visual Servo Control for Aerial Manipulation Using a Fully-Actuated UAV

Constrained trajectory optimization and force control for UAVs with universal jamming grippers

Machine Vision for UAS Ground Operations

Strategic Conflict Management using Recurrent Multi-agent Reinforcement Learning for Urban Air Mobility Operations Considering Uncertainties

Safety Assured Online Guidance With Airborne Separation for Urban Air Mobility Operations in Uncertain Environments

Aerial Manipulation Using a Novel Unmanned Aerial Vehicle Cyber-Physical System

Challenges in Close-Proximity Safe and Seamless Operation of Manned and Unmanned Aircraft in Shared Airspace

Safe and Scalable Real-Time Trajectory Planning Framework for Urban Air Mobility

Research on Aerial Autonomous Docking and Landing Technology of Dual Multi-Rotor UAV

Evaluation of Reinforcement and Deep Learning Algorithms in Controlling Unmanned Aerial Vehicles

Autonomous Vision-Based Aerial Grasping for Rotorcraft Unmanned Aerial Vehicles

Modeling and Control of MM-UAV: Mobile Manipulating Unmanned Aerial Vehicle

A Vision-Based Target Detection, Tracking, and Positioning Algorithm for Unmanned Aerial Vehicle

Integrated Conflict Management for UAM with Strategic Demand Capacity Balancing and Learning-based Tactical Deconfliction

A Dual Aircraft Maneuver Formation Controller for MAV/UAV Based on the Hybrid Intelligent Agent

Decentralized UAV Swarm Control: A Multi-Layered Architecture for Integrated Flight Mode Management and Dynamic Target Interception