Abstract:One of the core activities of an active observer involves moving to secure a "better" view of the scene, where the definition of "better" is task-dependent. This paper focuses on the task of human pose estimation from videos capturing a person's activity. Self-occlusions within the scene can complicate or even prevent accurate human pose estimation. To address this, relocating the camera to a new vantage point is necessary to clarify the view, thereby improving 2D human pose estimation. This paper formalizes the process of achieving an improved viewpoint. Our proposed solution to this challenge comprises three main components: a NeRF-based Drone-View Data Generation Framework, an On-Drone Network for Camera View Error Estimation, and a Combined Planner for devising a feasible motion plan to reposition the camera based on the predicted errors for camera views. The Data Generation Framework utilizes NeRF-based methods to generate a comprehensive dataset of human poses and activities, enhancing the drone's adaptability in various scenarios. The Camera View Error Estimation Network is designed to evaluate the current human pose and identify the most promising next viewing angles for the drone, ensuring a reliable and precise pose estimation from those angles. Finally, the combined planner incorporates these angles while considering the drone's physical and environmental limitations, employing efficient algorithms to navigate safe and effective flight paths. This system represents a significant advancement in active 2D human pose estimation for an autonomous UAV agent, offering substantial potential for applications in aerial cinematography by improving the performance of autonomous human pose estimation and maintaining the operational safety and efficiency of UAVs.

Homography-based Camera Pose Estimation with Known Gravity Direction for UAV Navigation

Robust And Accurate Multiple-Camera Pose Estimation Toward Robotic Applications

A New On-Board UAV Pose Estimation System Based on Monocular Camera

Globally Optimal Consensus Maximization for Relative Pose Estimation With Known Gravity Direction

Homography-Based Minimal-Case Relative Pose Estimation with Known Gravity Direction

A Homography-Based Visual Inertial Fusion Method for Robust Sensing of a Micro Aerial Vehicle

Globally Optimal Relative Pose Estimation for Multi-Camera Systems with Known Gravity Direction

Globally Optimal Relative Pose Estimation with Gravity Prior

Absolute Pose Estimation with a Known Direction by Motion Decoupling

A Monocular Odometer for a Quadrotor Using a Homography Model and Inertial Cues

Real-Time Cross-View Image Matching and Camera Pose Determination for Unmanned Aerial Vehicles

Inertial-aided State and Slope Estimation Using a Monocular Camera

Vision-based Mini Unmanned Helicopter Pose and Position Estimation

Homography Initialization and Dynamic Weighting Algorithm Based on a Downward-Looking Camera and IMU

Real-time Relative Pose Estimation for Muti-UAV Systems Using Odometry and UWB Measurements

A Pose Estimation Method for Indoor UAV Based on Binocular Vision

Globally Optimal Relative Pose and Scale Estimation from Only Image Correspondences with Known Vertical Direction

Active Human Pose Estimation via an Autonomous UAV Agent

Monocular visual-inertial state estimation on 3D large-scale scenes for UAVs navigation

A Method Of Getting Relative Elevation Proportion From Uav Images

Globally Optimal Relative Pose Estimation Using Affine Correspondences with Known Vertical Direction