Abstract:Human pose estimation has a variety of real-life applications, including human action recognition, AI-powered personal trainers, robotics, motion capture and augmented reality, gaming, and video surveillance. However, most current human pose estimation systems are based on RGB images, which do not seriously take into account personal privacy. Although identity-preserved algorithms are very desirable when human pose estimation is applied to scenarios where personal privacy does matter, developing human pose estimation algorithms based on identity-preserved modalities, such as thermal images concerned here, is very challenging due to the limited amount of training data currently available and the fact that infrared thermal images, unlike RGB images, lack rich texture cues which makes annotating training data itself impractical. In this paper, we formulate a new task with privacy protection that lies between human detection and human pose estimation by introducing a benchmark for IPHPDT (i.e., Identity-Preserved Human Posture Detection in Thermal images). This task has a threefold novel purpose: the first is to establish an identity-preserved task with thermal images; the second is to achieve more information other than the location of persons as provided by human detection for more advanced computer vision applications; the third is to avoid difficulties in collecting well-annotated data for human pose estimation in thermal images. The presented IPHPDT dataset contains four types of human postures, consisting of 75,000 images well-annotated with axis-aligned bounding boxes and postures of the persons. Based on this well-annotated IPHPDT dataset and three state-of-the-art algorithms, i.e., YOLOF (short for You Only Look One-level Feature), YOLOX (short for Exceeding YOLO Series in 2021) and TOOD (short for Task-aligned One-stage Object Detection), we establish three baseline detectors, called IPH-YOLOF, IPH-YOLOX, and IPH-TOOD. In the experiments, three baseline detectors are used to recognize four infrared human postures, and the mean average precision can reach 70.4%. The results show that the three baseline detectors can effectively perform accurate posture detection on the IPHPDT dataset. By releasing IPHPDT, we expect to encourage more future studies into human posture detection in infrared thermal images and draw more attention to this challenging task.

Human Pose Estimation Using Thermal Images

Modality-transfer Generative Adversarial Network and Dual-Level Unified Latent Representation for Visible Thermal Person Re-Identification

X-HRNet: Towards Lightweight Human Pose Estimation with Spatially Unidimensional Self-Attention

Poseur: Direct Human Pose Regression with Transformers.

Identity-Preserved Human Posture Detection in Infrared Thermal Images: A Benchmark

HEViTPose: High-Efficiency Vision Transformer for Human Pose Estimation

Human Pose Estimation in Monocular Omnidirectional Top-View Images

Modelling Human Body Pose for Action Recognition Using Deep Neural Networks

3D Human Pose Estimation with Spatial and Temporal Transformers

Human Pose Estimation from Depth Images via Inference Embedded Multi-task Learning

Towards Precise 3D Human Pose Estimation with Multi-Perspective Spatial-Temporal Relational Transformers

LWIRPOSE: A novel LWIR Thermal Image Dataset and Benchmark

Bilateral Pose Transformer for Human Pose Estimation.

What Happened 3 Seconds Ago? Inferring the Past with Thermal Imaging

Human pose regression by combining indirect part detection and contextual information

Hand Pose Estimation via Latent 2.5D Heatmap Regression

AnatPose: Bidirectionally learning anatomy-aware heatmaps for human pose estimation

HRPVT: High-Resolution Pyramid Vision Transformer for medium and small-scale human pose estimation

3D Human pose estimation from video via multi-scale multi-level spatial temporal features

Deep Dual Consecutive Network for Human Pose Estimation

TFPose: Direct Human Pose Estimation with Transformers