Abstract:This article presents an innovative method for planning and tracking the trajectory in the image plane for the visual control of a quadrotor. The community of researchers working on 2D control widely recognizes this challenge as complex, because a trajectory defined in image space can lead to unpredictable movements of the robot in Cartesian space. While researchers have addressed this problem for mobile robots, quadrotors continue to face significant challenges. To tackle this issue, the adopted approach involves considering the separation of altitude control from the other variables, thus reducing the workspace. Furthermore, the movements of the quadrotor (pitch, roll, and yaw) are interdependent. Consequently, the connection between the inputs and outputs cannot be reversed. The task complexity becomes significant. To address this issue, we propose the following scenario: When the quadrotor is equipped with a downward-facing camera, flying at high altitude is sensible to spot a target. However, to minimize disturbances and conserve energy, the quadrotor needs to descend in altitude. This can result in the target being lost. The solution to this problem is a new methodology based on the principle of differential flatness, allowing the separation of altitude control from the other variables. The system first detects the target at high altitude, then plots a trajectory in the image coordinate system between the acquired image and the desired image. It is crucial to emphasize that this step is performed offline, ensuring that the image processing time does not affect the control frequency. Through the proposed trajectory planning, complying with the constraints of differential flatness, the quadrotor can follow the imposed dynamics. To ensure the tracking of the target while following the generated trajectory, the proposed control law takes the form of an Image Based Visual Servoing (IBVS) scheme. We validated this method using the RVCTOOLS environment in MATLAB. The DJI Phantom 1 quadrotor served as a testbed to evaluate, under real conditions, the effectiveness of the proposed control law. We specifically designed an electronic card to transfer calculated commands to the DJI Phantom 1 control joystick via Bluetooth. This card integrates a PIC18F2520 microcontroller, a DAC8564 digital-to-analogue converter, and an RN42 Bluetooth module. The experimental results demonstrate the effectiveness of this method, ensuring the precise tracking of the target as well as the accurate tracking of the path generated in the image coordinate system.

Real-Time Drone (UAV) Trajectory Generation and Tracking by Optical Flow

Flow-Guided Single Object Tracking Framework in UAV Aerial Video

Fusing Stereopsis & Corner Sparse Optical Flow for Real-time Obstacle Avoidance of Unmanned Aerial Vehicle

Dynamic Illumination Optical Flow Computing for Sensing Multiple Mobile Robots from a Drone.

A Vision-based UAV Tracker Aiming at Aerial Targets

Vision-based Target Tracking for UAV and Relative Depth Estimation using Optical Flow

Self-localization of Unmanned Aerial Vehicles Based on Optical Flow in Onboard Camera Images

Vision-based drone control for autonomous UAV cinematography

UAV Landing Based on the Optical Flow Videonavigation

Real-Time Visual Tracking of Moving Targets Using a Low-Cost Unmanned Aerial Vehicle with a 3-Axis Stabilized Gimbal System

Seeing Through Pixel Motion: Learning Obstacle Avoidance from Optical Flow with One Camera

A Position Estimation and Control System for the Quadrotor in GPS-Deny Situation Based on FAST Detection and Optical Flow

Efficient Optical flow and Stereo Vision for Velocity Estimation and Obstacle Avoidance on an Autonomous Pocket Drone

Vision-based minimum-time trajectory generation for a quadrotor UAV

Optimal Trajectory Planning for Cinematography with Multiple Unmanned Aerial Vehicles

Artificial Potential Field Based Trajectory Tracking for Quadcopter UAV Moving Targets

Improvement in the UAV position estimation with low-cost GPS, INS and vision-based system: Application to a quadrotor UAV

A Novel Real-Time Moving Target Tracking and Path Planning System for a Quadrotor UAV in Unknown Unstructured Outdoor Scenes

An Advanced IBVS-Flatness Approach for Real-Time Quadrotor Navigation: A Full Control Scheme in the Image Plane

Vision-based adaptive prediction, planning, and execution of permissible and smooth trajectories for a 2DOF model helicopter

UAV Tracking with Lidar as a Camera Sensors in GNSS-Denied Environments