Abstract:Traditional heavy and complex control equipment such as remote controllers (RCs) and ground stations (GSs) are not able to meet the fast and flexible control requirements of unmanned aerial vehicles (UAVs) in complex environments. This article thus proposes a gesture recognition method for the control of UAVs. To achieve the goal of gestural manipulation of UAVs, this method can accurately recognize a variety of gestures and convert the gestures into corresponding UAV control commands. First, the wireless data glove incorporates flex sensors, and inertial sensors are used to gather gesture datasets. The trained neural network model is then deployed on the data glove based on an STM32 microcontroller for real-time gesture recognition, in which the backpropagation (BP) network is used for static gesture recognition and the bidirectional gated recurrent unit (Bi-GRU) network is used for dynamic gesture recognition. Finally, the gesture is converted into the control command and sent to the aircraft terminal to control the UAV. Using the UAV simulation test on the simulation platform, the recognition accuracy of the basic UAV control commands corresponding to ten static gestures is found to be 100%, and the mean recognition accuracy of the UAV mode-switching commands corresponding to five dynamic gestures is 98.4% indicating that the gesture recognition effect of the system is perfect. Mission testing performed in the scene constructed in the simulation environment demonstrates that the UAV can respond rapidly to gestures, and the method proposed in this article can achieve real-time and stable control of the UAV on the end side.

Gesture Controlled Hexacopter using MEMS Technology

Web-based Interactive Drone Control Using Hand Gesture

Virtual Interaction and Manipulation Control of a Hexacopter Through Hand Gesture Recognition from a Data Glove.

Design and Evaluation of an Alternative Control for a Quad-Rotor Drone Using Hand-Gesture Recognition

Dual-hand Gesture Controlled Quadcopter Robot

End-Side Gesture Recognition Method for UAV Control

Construction and control of monocopter using MEMS AHRS

HGIC: A Hand Gesture Based Interactive Control System for Efficient and Scalable Multi-UAV Operations

Wearable Drone Controller: Machine Learning-Based Hand Gesture Recognition and Vibrotactile Feedback

Monocular Snapshot-based Sensing and Control of Hover, Takeoff, and Landing for a Low-cost Quadrotor

Flyingbuddy2: A Brain-Controlled Assistant For The Handicapped

Research on Multi-modal Interactive Control for Quadrotor UAV

Developing of the smart quadcopter with improved flight dynamics and stability

Gesture-based Piloting of an Aerial Robot using Monocular Vision

MorphoArms: Morphogenetic Teleoperation of Multimanual Robot

Improvement of Hexacopter UAVs Attitude Parameters Employing Control and Decision Support Systems

Flight Control System for Micro Aerial Vehicles Based on MEMS Sensors

A Gesture Recognition System Based On MEMS Accelerometer

Gesture Control Menggunakan IMU MPU 6050 Metode Kalman Filter Sebagai Kendali Quadcopter

Control of a Drone in Virtual Reality Using MEMS Sensor Technology and Machine Learning

Modeling and Control of MM-UAV: Mobile Manipulating Unmanned Aerial Vehicle