Abstract:This article presents an innovative method for planning and tracking the trajectory in the image plane for the visual control of a quadrotor. The community of researchers working on 2D control widely recognizes this challenge as complex, because a trajectory defined in image space can lead to unpredictable movements of the robot in Cartesian space. While researchers have addressed this problem for mobile robots, quadrotors continue to face significant challenges. To tackle this issue, the adopted approach involves considering the separation of altitude control from the other variables, thus reducing the workspace. Furthermore, the movements of the quadrotor (pitch, roll, and yaw) are interdependent. Consequently, the connection between the inputs and outputs cannot be reversed. The task complexity becomes significant. To address this issue, we propose the following scenario: When the quadrotor is equipped with a downward-facing camera, flying at high altitude is sensible to spot a target. However, to minimize disturbances and conserve energy, the quadrotor needs to descend in altitude. This can result in the target being lost. The solution to this problem is a new methodology based on the principle of differential flatness, allowing the separation of altitude control from the other variables. The system first detects the target at high altitude, then plots a trajectory in the image coordinate system between the acquired image and the desired image. It is crucial to emphasize that this step is performed offline, ensuring that the image processing time does not affect the control frequency. Through the proposed trajectory planning, complying with the constraints of differential flatness, the quadrotor can follow the imposed dynamics. To ensure the tracking of the target while following the generated trajectory, the proposed control law takes the form of an Image Based Visual Servoing (IBVS) scheme. We validated this method using the RVCTOOLS environment in MATLAB. The DJI Phantom 1 quadrotor served as a testbed to evaluate, under real conditions, the effectiveness of the proposed control law. We specifically designed an electronic card to transfer calculated commands to the DJI Phantom 1 control joystick via Bluetooth. This card integrates a PIC18F2520 microcontroller, a DAC8564 digital-to-analogue converter, and an RN42 Bluetooth module. The experimental results demonstrate the effectiveness of this method, ensuring the precise tracking of the target as well as the accurate tracking of the path generated in the image coordinate system.

What problem does this paper attempt to address?

The paper attempts to address the problem of planning and tracking trajectories in the image plane to achieve visual control of a quadrotor. Specifically, the paper focuses on how to define trajectories in the image space without causing unpredictable motion of the robot in Cartesian space. While researchers have already addressed similar issues for mobile robots, quadrotors still face significant challenges. ### Main Issues: 1. **Inconsistency between Image Space and Cartesian Space**: Trajectories defined in the image space may lead to unpredictable motion of the quadrotor in Cartesian space. 2. **Coupling of Altitude Control with Other Variables**: There is a complex coupling between the altitude control of the quadrotor and other variables (such as pitch, roll, and yaw), making the system difficult to control. 3. **Target Loss Issue**: When the quadrotor descends from a high altitude, it may lose the target as the target might go out of the camera's field of view. 4. **Complexity of Real-time Control**: Visual servo control usually requires image processing, which may affect the control frequency, leading to target loss or control delays. ### Solutions: 1. **Differential Flatness-based Approach**: By decoupling altitude control from other variables, the complexity of the workspace is reduced. 2. **Trajectory Planning in the Image Plane**: First, detect the target from a high altitude, then plan a trajectory in the image coordinate system from the current image to the desired image. 3. **Conversion from Image Plane to Cartesian Space**: Convert the trajectory in the image plane to a trajectory in Cartesian space that is independent of altitude. 4. **Image-Based Visual Servoing (IBVS)**: Use IBVS control laws to ensure that the quadrotor can track the generated trajectory and maintain precise tracking of the target. ### Experimental Validation: - **Simulation Validation**: Use the RVCTOOLS environment in MATLAB for simulation to verify the effectiveness of the method. - **Actual Testing**: Use a DJI Phantom 1 quadrotor for actual testing, transmitting the calculated commands to the control stick via Bluetooth to ensure precise tracking of the trajectory and target. In summary, the paper proposes a novel method based on differential flatness and image plane visual servoing to address the complex problem of trajectory planning and tracking in the image space for quadrotors, improving the system's stability and real-time performance.

An Advanced IBVS-Flatness Approach for Real-Time Quadrotor Navigation: A Full Control Scheme in the Image Plane

Vision-based control of a quadrotor utilizing artificial neural networks for tracking of moving targets

Sensing and Control of a Quadrotor Using a Visual Inertial Fusion Method

An Innovative Collision-Free Image-Based Visual Servoing Method for Mobile Robot Navigation Based on the Path Planning in the Image Plan

Vision-based adaptive prediction, planning, and execution of permissible and smooth trajectories for a 2DOF model helicopter

Image-Based Visual Servoing of Rotorcrafts to Planar Visual Targets of Arbitrary Orientation

Quadcopter Tracking Using Euler-Angle-Free Flatness-Based Control

Robust vision-based control of an underactuated flying robot tracking a moving target

Onboard Hover Control of a Quadrotor using Template Matching and Optic Flow

Quadrotor going through a window and landing: An image-based visual servo control approach

Adaptive visual servo control law for finite-time tracking to land quadrotor on moving platform using virtual reticle algorithm

Robust Observer-Based Visual Servo Control for Quadrotors Tracking Unknown Moving Targets

Perception-Aware Image-Based Visual Servoing of Aggressive Quadrotor UAVs

Image-based finite-time visual servoing of a quadrotor for tracking a moving target

Nonlinear Vision-Based Observer for Visual Servo Control of an Aerial Robot in Global Positioning System Denied Environments

Image-Based Visual Servoing of Quadrotors to Arbitrary Flight Targets

Vision-based minimum-time trajectory generation for a quadrotor UAV

Image-based Visual Servoing Control of a Quadcopter Air Vehicle

Real-time Quadrotor Navigation Through Planning in Depth Space in Unstructured Environments

Robust Trajectory Tracking Control and Obstacles Avoidance Algorithm for Quadrotor Unmanned Aerial Vehicle

Visual servoing of quadrotor UAVs for slant targets with autonomous object search