Abstract:Small multi-rotor unmanned aerial vehicles (UAVs), mainly quadcopters, are nowadays ubiquitous in research on aerial autonomy, including serving as scaled-down models for much larger aircraft such as vertical-take-off-and-lift vehicles for urban air mobility. Among the various research use cases, first-person-view RC flight experiments allow for collecting data on how human pilots fly such aircraft, which could then be used to compare, contrast, validate, or train autonomous flight agents. While this could be uniquely beneficial, especially for studying UAV operation in contextually complex and safety-critical environments such as in human-UAV shared spaces, the lack of inexpensive and open-source hardware/software platforms that offer this capability along with low-level access to the underlying control software and data remains limited. To address this gap and significantly reduce barriers to human-guided autonomy research with UAVs, this paper presents an open-source software architecture implemented with an inexpensive in-house built quadcopter platform based on the F450 Quadcopter Frame. This setup uses two cameras to provide a dual-view FPV and an open-source flight controller, Pixhawk. The underlying software architecture, developed using the Python-based Kivy library, allows logging telemetry, GPS, control inputs, and camera frame data in a synchronized manner on the ground station computer. Since costs (time) and weather constraints typically limit numbers of physical outdoor flight experiments, this paper also presents a unique AirSim/Unreal Engine based simulation environment and graphical user interface aka digital twin, that provides a Hardware In The Loop setup via the Pixhawk flight controller. We demonstrate the usability and reliability of the overall framework through a set of diverse physical FPV flight experiments and corresponding flight tests in the digital twin.

CardKit: A Card-Based Programming Framework for Drones

A Trajectory-based Flight Assistive System for Novice Pilots in Drone Racing Scenario

Polynomial-based Online Planning for Autonomous Drone Racing in Dynamic Environments

Code Drones

Using Programmable Drone in Educational Projects and Competitions

Web-based Interactive Drone Control Using Hand Gesture

CARDinality: Interactive Card-shaped Robots with Locomotion and Haptics using Vibration

Open-Source Drone Programming Course for Distance Engineering Education

Advanced Autonomy on a Low-Cost Educational Drone Platform

Lowering Barriers to Entry for Fully-Integrated Custom Payloads on a DJI Matrice

Directing Cinematographic Drones

Trial by Flyer: Building Quadcopters From Scratch in a Ten-Week Capstone Course

Easy Coding in Biology: Pilot Workshop Design and Experiences from Block-Based Programming with in Secondary Education

Shaping and Being Shaped by Drones: Supporting Perception-Action Loops

AI Wings: An AIoT Drone System for Commanding ArduPilot UAVs

Don't Drone Yourself in Work: Discussing DronOS as a Framework for Human-Drone Interaction

CrowdKit: A Generic Programming Framework for Mobile Crowdsensing Applications

An Open-source Hardware/Software Architecture and Supporting Simulation Environment to Perform Human FPV Flight Demonstrations for Unmanned Aerial Vehicle Autonomy

Simulation environment for development of quad-copter controls incorporating physical environment in urban setting

A Model Design in UAV Technology: A Multi-controller-based Wi-Fi Imaging Drone

A novel Skill-based Programming Paradigm based on Autonomous Playing and Skill-centric Testing