Free as a Bird: Event-based Dynamic Sense-and-Avoid for Ornithopter Robot Flight

J.P. Rodríguez-Gómez,R. Tapia,M.M. Guzmán,J.R. Martínez-de Dios,A. Ollero

DOI: https://doi.org/10.1109/LRA.2022.3153904

2023-10-16

Abstract:Autonomous flight of flapping-wing robots is a major challenge for robot perception. Most of the previous sense-and-avoid works have studied the problem of obstacle avoidance for flapping-wing robots considering only static obstacles. This paper presents a fully onboard dynamic sense-and-avoid scheme for large-scale ornithopters using event cameras. These sensors trigger pixel information due to changes of illumination in the scene such as those produced by dynamic objects. The method performs event-by-event processing in low-cost hardware such as those onboard small aerial vehicles. The proposed scheme detects obstacles and evaluates possible collisions with the robot body. The onboard controller actuates over the horizontal and vertical tail deflections to execute the avoidance maneuver. The scheme is validated in both indoor and outdoor scenarios using obstacles of different shapes and sizes. To the best of the authors' knowledge, this is the first event-based method for dynamic obstacle avoidance in a flapping-wing robot.

Robotics

What problem does this paper attempt to address?

The paper primarily addresses the problem of dynamic obstacle perception and avoidance in autonomous flight of ornithopters. Specifically, the contributions of the paper can be summarized as follows:

1. **Event Camera-Based Dynamic Obstacle Motion Estimation Method**: This method leverages the characteristics of event cameras by detecting dynamic obstacles through the analysis of pixel events triggered by these obstacles and estimating their motion direction. This approach processes each event in real-time, rather than using traditional frame-based image processing, thereby significantly reducing processing latency.

2. **Reactive Obstacle Avoidance Method**: For large-scale ornithopters, this method provides a low-latency onboard perception and control solution. When a potential collision risk is detected, the robot quickly adjusts its horizontal and vertical tail deflection angles to perform avoidance maneuvers.

3. **Experimental Validation**: The methods described in the paper have been validated in both indoor and outdoor environments, using obstacles of various shapes and sizes. The experiments were conducted on a large-scale ornithopter named GRIFFIN E-Flap. To the best of the authors' knowledge, this is the first time that event camera technology has been used to design and validate a dynamic obstacle avoidance method for ornithopters.

The research background of the paper includes the challenges faced by ornithopters, such as vibrations, strict load limitations, and energy constraints. These factors collectively contribute to the difficulty in developing onboard perception and control methods. The proposed method overcomes these challenges, enabling ornithopters to respond quickly when facing dynamic obstacles.