Abstract:This paper presents a novel and efficient head pose estimation framework based on particle swarm optimized contrastive learning and multimodal entangled graph convolution network, aiming to solve the complexity nonlinear mapping from 2D feature space to 3D pose space. Head pose estimation is an especially challenging task due to the complexity nonlinear mapping from 2D feature space to 3D pose space. To address the above issue, this paper presents a novel and efficient head pose estimation framework based on particle swarm optimized contrastive learning and multimodal entangled graph convolution network. Firstly, a new network, the region and difference‐aware feature pyramid network (RD‐FPN), is proposed for 2D keypoints detection to alleviate the background interference and enhance the feature expressiveness. Then, particle swarm optimized contrastive learning is constructed to alternatively match 2D and 3D keypoints, which takes the multimodal keypoints matching accuracy as the optimization objective, while considering the similarity of cross‐modal positive and negative sample pairs from contrastive learning as a local contrastive constraint. Finally, multimodal entangled graph convolution network is designed to enhance the ability of establishing geometric relationships between keypoints and head pose angles based on second‐order bilinear attention, in which point‐edge attention is introduced to improve the representation of geometric features between multimodal keypoints. Compared with other methods, the average error of our method is reduced by 8.23%, indicating the accuracy, generalization, and efficiency of our method on the 300W‐LP, AFLW2000, BIWI datasets.

Static Head Pose Estimation under Different Illumination

Partially Occluded Head Posture Estimation for 2D Images Using Pyramid HoG Features

A Study of Two Image Representations for Head Pose Estimation

Facial Feature Localization Using Robust Active Shape Model and POEM Descriptors

Pose Estimation Via Complex-Frequency Domain Analysis of Image Gradient Orientations.

Head pose estimation from low-resolution image with hough forest

Pose Estimating of Pose-Varied Face Image

Pose Discrimination Based on Cpca-Svm in Dynamic System

Human Pose Estimation in Static Images Based on Region Segmentation and Monte Carlo Sampling

Head Pose Estimation Based on a Second Order Histogram of the Orientation Gradient

Head-Pose Estimation Based on Lateral Canthus Localizations in 2-D Images

Approach of Human Face Recognition Based on SIFT Feature Extraction and 3D Rotation Model

Phow Based Feature Detection for Head Pose Estimation

Robust Head-Pose Estimation Based on Partially-Latent Mixture of Linear Regressions

A Pose Estimation Method Based on Sparsity Judgment

Free-Head Pose Estimation under Low-Resolution Scenarios

View independent human posture identification using Kinect

Head Pose Estimation Using Covariance of Oriented Gradients

Head pose estimation with particle swarm optimization‐based contrastive learning and multimodal entangled GCN

Pose Estimation Using Polarimetric Imaging in Low-Light Environment

A new representation method of head images for head pose estimation