Abstract:Until recently Intelligence, Surveillance, and Reconnaissance (ISR) focused on acquiring behavioral information of the targets and their activities. Continuous evolution of intelligence being gathered of the human centric activities has put increased focus on the humans, especially inferring their innate characteristics - size, shapes and physiology. These bio-signatures extracted from the surveillance sensors can be used to deduce age, ethnicity, gender and actions, and further characterize human actions in unseen scenarios. However, recovery of pose and shape of humans in such monocular videos is inherently an ill-posed problem, marked by frequent depth and view based ambiguities due to self-occlusion, foreshortening and misalignment. The likelihood function often yields a highly multimodal posterior that is difficult to propagate even using the most advanced particle filtering(PF) algorithms. Motivated by the recent success of the discriminative approaches to efficiently predict 3D poses directly from the 2D images, we present several principled approaches to integrate predictive cues using learned regression models to sustain multimodality of the posterior during tracking. Additionally, these learned priors can be actively adapted to the test data using a likelihood based feedback mechanism. Estimated 3D poses are then used to fit 3D human shape model to each frame independently for inferring anthropometric bio-signatures. The proposed system is fully automated, robust to noisy test data and has ability to swiftly recover from tracking failures even after confronting with significant errors. We evaluate the system on a large number of monocular human motion sequences.

Optical Non-Line-of-Sight Physics-based 3D Human Pose Estimation

Active non-line-of-sight human pose estimation based on deep learning

LPSNet: End-to-End Human Pose and Shape Estimation with Lensless Imaging

Embodied Scene-aware Human Pose Estimation

Coupling Top-down and Bottom-up Methods for 3D Human Pose and Shape Estimation from Monocular Image Sequences

Hybrid 3D Human Pose Estimation with Monocular Video and Sparse IMUs

Multi-Person 3d Pose Estimation From Monocular Image Sequences

Improving Real-Time Omnidirectional 3D Multi-Person Human Pose Estimation with People Matching and Unsupervised 2D-3D Lifting

LidPose: Real-Time 3D Human Pose Estimation in Sparse Lidar Point Clouds with Non-Repetitive Circular Scanning Pattern

Unified End-to-End YOLOv5-HR-TCM Framework for Automatic 2D/3D Human Pose Estimation for Real-Time Applications

Sparseness Meets Deepness: 3D Human Pose Estimation from Monocular Video

3D Human Pose Estimation using Spatio-Temporal Networks with Explicit Occlusion Training

HPOF:3D Human Pose Recovery from Monocular Video with Optical Flow

Robust Estimation of 3D Human Poses from a Single Image

3D Human Body Shape and Pose Estimation from Depth Image.

Real-time human pose recognition in parts from single depth images

3D Human Pose Estimation via Intuitive Physics

Towards Locality Similarity Preserving to 3D Human Pose Estimation.

Self-Supervised 3D Human Pose Estimation in Static Video Via Neural Rendering

RSB-Pose: Robust Short-Baseline Binocular 3D Human Pose Estimation with Occlusion Handling

3D Human Pose Estimation = 2D Pose Estimation + Matching