Abstract:One of the core activities of an active observer involves moving to secure a "better" view of the scene, where the definition of "better" is task-dependent. This paper focuses on the task of human pose estimation from videos capturing a person's activity. Self-occlusions within the scene can complicate or even prevent accurate human pose estimation. To address this, relocating the camera to a new vantage point is necessary to clarify the view, thereby improving 2D human pose estimation. This paper formalizes the process of achieving an improved viewpoint. Our proposed solution to this challenge comprises three main components: a NeRF-based Drone-View Data Generation Framework, an On-Drone Network for Camera View Error Estimation, and a Combined Planner for devising a feasible motion plan to reposition the camera based on the predicted errors for camera views. The Data Generation Framework utilizes NeRF-based methods to generate a comprehensive dataset of human poses and activities, enhancing the drone's adaptability in various scenarios. The Camera View Error Estimation Network is designed to evaluate the current human pose and identify the most promising next viewing angles for the drone, ensuring a reliable and precise pose estimation from those angles. Finally, the combined planner incorporates these angles while considering the drone's physical and environmental limitations, employing efficient algorithms to navigate safe and effective flight paths. This system represents a significant advancement in active 2D human pose estimation for an autonomous UAV agent, offering substantial potential for applications in aerial cinematography by improving the performance of autonomous human pose estimation and maintaining the operational safety and efficiency of UAVs.

Wi-Fi-Inertial Indoor Pose Estimation for Microaerial Vehicles

WiFi-Inertial Indoor Pose Estimation for Micro Aerial Vehicles

RF Backscatter-based State Estimation for Micro Aerial Vehicles

VID-Fusion: Robust Visual-Inertial-Dynamics Odometry for Accurate External Force Estimation

Efficient Global Indoor Localization for Micro Aerial Vehicles

State estimation of autonomous rotorcraft MAVs under indoor environments

Invariant Observer-Based State Estimation for Micro-Aerial Vehicles in GPS-Denied Indoor Environments Using an RGB-D Camera and MEMS Inertial Sensors.

An Attitude Estimation Method for MAV Based on the Detection of Vanishing Point

LoRa Backscatter Assisted State Estimator for Micro Aerial Vehicles with Online Initialization

Indoor Integrated Navigation of Micro Aerial Vehicle Based on Radar-Scanner and Inertial Navigation System

A Homography-Based Visual Inertial Fusion Method for Robust Sensing of a Micro Aerial Vehicle

Visual Odometry and 3D Mapping in Indoor Environments

Combined RGBD-inertial based state estimation for MAV in GPS-denied indoor environments

Invariant Extended Kalman Filter-based state estimation for MAV in GPS-denied environments

A Hybrid Slam Method For Indoor Micro Aerial Vehicles

Autonomous aerial navigation using monocular visual-inertial fusion

Developing Smart MAVs for Autonomous Inspection in GPS-denied Constructions

Wi-drone

Active Human Pose Estimation via an Autonomous UAV Agent

Toward Autonomy of Micro Aerial Vehicles in Unknown and Global Positioning System Denied Environments

Invariant Observer Design of a RGB-D Aided Inertial System for MAV in GPS-Denied Environments