Abstract:In pedestrian-to-vehicle collision accidents, adapting safety measures ahead of time based on actual pose of pedestrians is one of the core objectives for integrated safety. It can significantly enhance the performance of passive safety system when active safety maneuvers fail to avoid accidents. This study proposes a deep learning model to estimate 3D pose of pedestrians from images. Since conventional pedestrian image datasets do not have available pose features to work with, a computer graphics-based (CG) framework is established to train the system with synthetic images. Biofidelic 3D meshes of standing males are first transformed into several walking poses, and then rendered as images from multiple view angles. Subsequently, a matrix of 50 anthropometries, 10 gaits and 12 views is built, in total of 6000 images. A two-branch convolutional neural network (CNN) was trained on the synthetic dataset. The model can simultaneously predict 16 joint landmarks and 14 joint angles of pedestrian for each image with high accuracy. Mean errors of the predictions are 0.54 pixels and − 0.06°, respectively. Any specific pose can then be completely reconstructed from the outputs. Overall, the current study has established a CG-based pipeline to generate photorealistic images with desired features for the training; it demonstrates the feasibility of leveraging CNN to estimate the pose of a walking pedestrian from synthesized images. The proposed framework provides a starting point for vehicles to infer pedestrian poses and then adapt protection measures accordingly for imminent impact to minimize pedestrian injuries.

Appearance based pedestrians' head pose and body orientation estimation using deep learning.

Modelling Human Body Pose for Action Recognition Using Deep Neural Networks

Part-wise pedestrian gender recognition via deep convolutional neural networks

A Computer Graphics-Based Framework for 3D Pose Estimation of Pedestrians

Learning Deep Features from Body and Parts for Person Re-Identification in Camera Networks

Human Pose Estimation Using Deep Structure Guided Learning.

Pedestrian Re-Id Based on Deep Feature

Learning a Deep Regression Forest for Head Pose Estimation from a Single Depth Image

An Effective Deep Network for Head Pose Estimation without Keypoints

Head Detection Based on Convolutional Neural Network with Multi-Stage Weighted Feature

Pedestrian Detection in Crowded Crowd Scene Based on Deep Learning

CNN Network for Head Detection with Depth Images in cyber-physical systems

Multi-Human Pose Estimation by Deep Learning-Based Sequential Approach for Human Keypoint Position and Human Body Detection

Simultaneous Face Detection And Head Pose Estimation: A Fast And Unified Framework

On-Board Pedestrian and Cyclist Recognition Using Deep Learning Methods

Continuous Pedestrian Orientation Estimation Using Human Keypoints.

Free-Head Pose Estimation under Low-Resolution Scenarios

Two-Stage Pedestrian Detection Model Using a New Classification Head for Domain Generalization

Monocular Pedestrian Orientation Estimation Based on Deep 2D-3D Feedforward

Learning Cross-Modal Deep Representations for Robust Pedestrian Detection

Deep3DPose: Realtime Reconstruction of Arbitrarily Posed Human Bodies from Single RGB Images