Abstract:Small multi-rotor unmanned aerial vehicles (UAVs), mainly quadcopters, are nowadays ubiquitous in research on aerial autonomy, including serving as scaled-down models for much larger aircraft such as vertical-take-off-and-lift vehicles for urban air mobility. Among the various research use cases, first-person-view RC flight experiments allow for collecting data on how human pilots fly such aircraft, which could then be used to compare, contrast, validate, or train autonomous flight agents. While this could be uniquely beneficial, especially for studying UAV operation in contextually complex and safety-critical environments such as in human-UAV shared spaces, the lack of inexpensive and open-source hardware/software platforms that offer this capability along with low-level access to the underlying control software and data remains limited. To address this gap and significantly reduce barriers to human-guided autonomy research with UAVs, this paper presents an open-source software architecture implemented with an inexpensive in-house built quadcopter platform based on the F450 Quadcopter Frame. This setup uses two cameras to provide a dual-view FPV and an open-source flight controller, Pixhawk. The underlying software architecture, developed using the Python-based Kivy library, allows logging telemetry, GPS, control inputs, and camera frame data in a synchronized manner on the ground station computer. Since costs (time) and weather constraints typically limit numbers of physical outdoor flight experiments, this paper also presents a unique AirSim/Unreal Engine based simulation environment and graphical user interface aka digital twin, that provides a Hardware In The Loop setup via the Pixhawk flight controller. We demonstrate the usability and reliability of the overall framework through a set of diverse physical FPV flight experiments and corresponding flight tests in the digital twin.

AUTONOMOUS FLIGHT CONTROL AND HARDWARE-IN-THE-LOOP SIMULATOR FOR A SMALL HELICOPTER

Control System Design and Flight Testing for a Miniature Unmanned Helicopter

Software and hardware environments for simulation and verification of an autonomous flight control based on fuzzy logic control for small unmanned helicopter

Design of Hardware-In-Loop Simulation System for Unmanned Aerial Vehicle

Design and Hardware-in-the-loop Simulation of MUAV's Flight Control System

A 3-Axis Flight Simulator for Micro Unmanned Helicopter

PaTAVTT: A Hardware-in-the-Loop Scaled Platform for Testing Autonomous Vehicle Trajectory Tracking

Autonomous Flight Control of Unmanned Small Hobby-Class Helicopter Report 1: Hardware Development and Verification Experiments of Autonomous Flight Control System

Development of a hardware-in-the-loop demonstrator for the validation of fault-tolerant control methods for a hybrid UAV

Hardware-in-the-Loop for Characterization of Embedded State Estimation for Flying Microrobots

Vertical Modeling and Autonomous Landing of a Mini Unmanned Helicopter

Intelligent Rotor Speed Controller for a Mini Autonomous Helicopter.

Robust flight control of small-scale unmanned helicopter

Hierarchical Hybrid Control System of Small Unmanned Helicopter

An Open-source Hardware/Software Architecture and Supporting Simulation Environment to Perform Human FPV Flight Demonstrations for Unmanned Aerial Vehicle Autonomy

Development of a three degree-of-freedom testbed for an unmanned helicopter and attitude control design

Hardware-in-the-loop simulator for research on fault tolerant control of electrohydraulic actuators in a flight control application

Design, implementation and verification of hardware-in-the-loop control system for work-class ROVs

Hardware in the Loop Simulation and Control Design for Autonomous Free Running Ship Models

Hardware In The Loop Simulator in UAV Rapid Development Life Cycle

Research and Practice of a 30-class Autonomous Helicopter System