Abstract:To mitigate the challenges arising from partial occlusion in human pose keypoint based pedestrian detection methods , we present a novel pedestrian pose keypoint completion method called the separation and dimensionality reduction-based generative adversarial imputation networks (SDR-GAIN) . Firstly, we utilize OpenPose to estimate pedestrian poses in images. Then, we isolate the head and torso keypoints of pedestrians with incomplete keypoints due to occlusion or other factors and perform dimensionality reduction to enhance features and further unify feature distribution. Finally, we introduce two generative models based on the generative adversarial networks (GAN) framework, which incorporate Huber loss, residual structure, and L1 regularization to generate missing parts of the incomplete head and torso pose keypoints of partially occluded pedestrians, resulting in pose completion. Our experiments on MS COCO and JAAD datasets demonstrate that SDR-GAIN outperforms basic GAIN framework, interpolation methods PCHIP and MAkima, machine learning methods k-NN and MissForest in terms of pose completion task. Furthermore, the SDR-GAIN algorithm exhibits a remarkably short running time of approximately 0.4ms and boasts exceptional real-time performance. As such, it holds significant practical value in the domain of autonomous driving, wherein high system response speeds are of paramount importance. Specifically, it excels at rapidly and precisely capturing human pose key points, thus enabling an expanded range of applications for pedestrian detection tasks based on pose key points, including but not limited to pedestrian behavior recognition and prediction.

An end-to-end framework for pose estimation of occluded pedestrians

An End-to-End Framework for Unsupervised Pose Estimation of Occluded Pedestrians

Deep Multi-Task Networks For Occluded Pedestrian Pose Estimation

A comprehensive framework for occluded human pose estimation

Seek and You Will Find: A New Optimized Framework for Efficient Detection of Pedestrian

PedHunter: Occlusion Robust Pedestrian Detector in Crowded Scenes

Out of the Box: A combined approach for handling occlusion in Human Pose Estimation

A Computer Graphics-Based Framework for 3D Pose Estimation of Pedestrians

An Integrated Deep Learning Framework for Occluded Pedestrian Tracking.

Peeking into occluded joints: A novel framework for crowd pose estimation

Solving Occlusion Problem in Pedestrian Detection by Constructing Discriminative Part Layers

Imagine the Unseen: Occluded Pedestrian Detection via Adversarial Feature Completion

Learning Pixel-Level and Instance-Level Context-Aware Features for Pedestrian Detection in Crowds.

POISE: Pose Guided Human Silhouette Extraction under Occlusions

PSC-Net: learning part spatial co-occurrence for occluded pedestrian detection

Mask-Guided Attention Network for Occluded Pedestrian Detection

Taking a Look at Small-Scale Pedestrians and Occluded Pedestrians

Occluded Pedestrian Detection Combined with Semantic Features.

SDR-GAIN: A High Real-Time Occluded Pedestrian Pose Completion Method for Autonomous Driving

An Objective Method for Pedestrian Occlusion Level Classification

Occluded Gait Recognition.