Abstract:ObjectiveThe difficulty of unmanned aerial vehicle (UAV) control recently lies in multidirectional movement in 3-dimensional space, improving control accuracy and manipulation safety. To address these challenges, a UAV control system that incorporates a hybrid brain-computer interface (hBCI), gyroscope and visual obstacle avoidance based on monocular depth estimation is proposed. Approach. We propose an efficient steady-state visual evoked potential (SSVEP) classification network (CL-NET) featuring a one-dimensional convolutional neural network, a long short-term memory module and an attention module to identify the user's intention for UAV movement in the front, back, left and right directions. The take-off, landing and rising control of the UAV is realized by an electrooculogram (EOG) signal detection algorithm, a blink state detector. In addition, the UAV can fly in an oblique state and rotate according to the current head posture detected by a gyroscope. Furthermore, an improved monocular depth estimation network is employed to design the autonomous obstacle avoidance module of the UAV, ensuring the safety of the brain-controlled system in practice. Main results. The proposed CL-NET delivers an accuracy of 98.67% on the public dataset and an accuracy of 97.92% on the self-collected dataset, both of which surpass the performance of state-of-the-art models. Additionally, we set up a brain control group and a remote control group to conduct practical experiments in a realistic environment. In the experiments involving sixteen subjects, the proposed UAV control system reached an average information transfer rate (ITR) of 44.09 bits/min, and the brain control group had a lower collision rate than the remote control group. Significance. The hybrid control method ensures that the multi-degree-of-freedom (multi-DOF) UAV control system maintains outstanding performance while ensuring good safety.

Cognitive Control Architecture for the Practical Realization of UAV Collision Avoidance

Safety Control Means for UAVs Based on Cognition-Guidance

The collision avoidance control algorithm of the UAV formation flight

A Study on Path Planning Algorithms of UAV Collision Avoidance

Collision Avoidance in Fixed-Wing UAV Formation Flight Based on a Consensus Control Algorithm

Research on Autonomous Control System Structure of Ucav Based on Cognitive Science

Fixed-Wing UAV Formation Control Design with Collision Avoidance Based on an Improved Artificial Potential Field

Design and Information Architectures for an Unmanned Aerial Vehicle Cooperative Formation Tracking Controller.

Traffic Collisions Early Warning Aided by Small Unmanned Aerial Vehicle Companion

Local Pursuit Strategy-Inspired Cooperative Formation Flight and Collision Avoidance for UAV Cluster

An Air Combat Decision Learning System Based on a Brain-Like Cognitive Mechanism

A Hierarchical Collision Avoidance Architecture for Multiple Fixed-Wing UAVs in an Integrated Airspace

Systematic Review of Collision-Avoidance Approaches for Unmanned Aerial Vehicles

Deep-Reinforcement-Learning-Based Collision Avoidance in UAV Environment

Toward collision-free trajectory for autonomous and pilot-controlled unmanned aerial vehicles

New Development on Sense and Avoid Strategies for Unmanned Aerial Vehicles

UAV Multi-Dynamic Target Interception: A Hybrid Intelligent Method Using Deep Reinforcement Learning and Fuzzy Logic

Multi-degree-of-freedom Unmanned Aerial Vehicle Control Combining a Hybrid Brain-Computer Interface and Visual Obstacle Avoidance

GrpAvoid: Multigroup Collision-Avoidance Control and Optimization for UAV Swarm

A Study on UAV Formation Collision Avoidance

Reinforcement Learning-Based Collision Avoidance Guidance Algorithm for Fixed-Wing UAVs.