Abstract:One of the core activities of an active observer involves moving to secure a "better" view of the scene, where the definition of "better" is task-dependent. This paper focuses on the task of human pose estimation from videos capturing a person's activity. Self-occlusions within the scene can complicate or even prevent accurate human pose estimation. To address this, relocating the camera to a new vantage point is necessary to clarify the view, thereby improving 2D human pose estimation. This paper formalizes the process of achieving an improved viewpoint. Our proposed solution to this challenge comprises three main components: a NeRF-based Drone-View Data Generation Framework, an On-Drone Network for Camera View Error Estimation, and a Combined Planner for devising a feasible motion plan to reposition the camera based on the predicted errors for camera views. The Data Generation Framework utilizes NeRF-based methods to generate a comprehensive dataset of human poses and activities, enhancing the drone's adaptability in various scenarios. The Camera View Error Estimation Network is designed to evaluate the current human pose and identify the most promising next viewing angles for the drone, ensuring a reliable and precise pose estimation from those angles. Finally, the combined planner incorporates these angles while considering the drone's physical and environmental limitations, employing efficient algorithms to navigate safe and effective flight paths. This system represents a significant advancement in active 2D human pose estimation for an autonomous UAV agent, offering substantial potential for applications in aerial cinematography by improving the performance of autonomous human pose estimation and maintaining the operational safety and efficiency of UAVs.

An RGB-D-Based Cross-Field of View Pose Estimation System for a Free Flight Target in a Wind Tunnel

Pose Estimation and Neural Implicit Reconstruction Towards Non-Cooperative Spacecraft Without Offline Prior Information

Recurrent Volume-based 3D Feature Fusion for Real-time Multi-view Object Pose Estimation

Recurrent Volume-Based 3-D Feature Fusion for Real-Time Multiview Object Pose Estimation.

Drogue Pose Estimation Based on Ultraviolet Camera and Asymmetric Markers.

Zero-Shot 3d Pose Estimation of Unseen Object by Two-Step Rgb-D Fusion

Feature Regions Segmentation Based RGB-D Visual Odometry in Dynamic Environment

Large-Scale Aircraft Pose Estimation System Based on Depth Cameras

Robust 3D Reconstruction with an RGB-D Camera

Relative Pose Estimation of Non-Cooperative Space Targets Using a TOF Camera

Robust Depth-Aided RGBD-Inertial Odometry for Indoor Localization

Real-Time Cross-View Image Matching and Camera Pose Determination for Unmanned Aerial Vehicles

A Relative Pose Estimation Method of Non-Cooperative Space Targets

Real-Time Accurate 3D Head Tracking and Pose Estimation with Consumer RGB-D Cameras

6D Pose Estimation for Textureless Objects on RGB Frames using Multi-View Optimization

Real-time RGBD-based Extended Body Pose Estimation

Active Human Pose Estimation via an Autonomous UAV Agent

Real-Time Through-Wall Multiperson 3-D Pose Estimation Based on MIMO Radar

img2pose: Face Alignment and Detection via 6DoF, Face Pose Estimation

Learning to Estimate 6DoF Pose from Limited Data: A Few-Shot, Generalizable Approach using RGB Images

Stereo Vision Based Floor Plane Extraction and Camera Pose Estimation