Abstract:Human pose estimation has a variety of real-life applications, including human action recognition, AI-powered personal trainers, robotics, motion capture and augmented reality, gaming, and video surveillance. However, most current human pose estimation systems are based on RGB images, which do not seriously take into account personal privacy. Although identity-preserved algorithms are very desirable when human pose estimation is applied to scenarios where personal privacy does matter, developing human pose estimation algorithms based on identity-preserved modalities, such as thermal images concerned here, is very challenging due to the limited amount of training data currently available and the fact that infrared thermal images, unlike RGB images, lack rich texture cues which makes annotating training data itself impractical. In this paper, we formulate a new task with privacy protection that lies between human detection and human pose estimation by introducing a benchmark for IPHPDT (i.e., Identity-Preserved Human Posture Detection in Thermal images). This task has a threefold novel purpose: the first is to establish an identity-preserved task with thermal images; the second is to achieve more information other than the location of persons as provided by human detection for more advanced computer vision applications; the third is to avoid difficulties in collecting well-annotated data for human pose estimation in thermal images. The presented IPHPDT dataset contains four types of human postures, consisting of 75,000 images well-annotated with axis-aligned bounding boxes and postures of the persons. Based on this well-annotated IPHPDT dataset and three state-of-the-art algorithms, i.e., YOLOF (short for You Only Look One-level Feature), YOLOX (short for Exceeding YOLO Series in 2021) and TOOD (short for Task-aligned One-stage Object Detection), we establish three baseline detectors, called IPH-YOLOF, IPH-YOLOX, and IPH-TOOD. In the experiments, three baseline detectors are used to recognize four infrared human postures, and the mean average precision can reach 70.4%. The results show that the three baseline detectors can effectively perform accurate posture detection on the IPHPDT dataset. By releasing IPHPDT, we expect to encourage more future studies into human posture detection in infrared thermal images and draw more attention to this challenging task.

A Low-Resolution Infrared Array for Unobtrusive Human Activity Recognition That Preserves Privacy

Privacy-preserving Activity Recognition Using Multimodal Sensors in Smart Office

Workplace programmes for HIV and tuberculosis: A systematic review to support development of international guidelines for the health workforce

A Mini-Survey and Feasibility Study of Deep-Learning-Based Human Activity Recognition from Slight Feature Signals Obtained Using Privacy-Aware Environmental Sensors

TADAR: Thermal Array-based Detection and Ranging for Privacy-Preserving Human Sensing

Identity-Preserved Human Posture Detection in Infrared Thermal Images: A Benchmark

Visualization As Intermediate Representations (VLAIR) for Human Activity Recognition.

Modeling the Trade-off of Privacy Preservation and Activity Recognition on Low-Resolution Images

Privacy-Preserving Cross-Environment Human Activity Recognition

Intelligent Reflecting Surface-Based Non-LOS Human Activity Recognition for Next-Generation 6G-Enabled Healthcare System

Real Time 3D Indoor Human Image Capturing Based on FMCW Radar

Energy-efficient and Privacy-aware Social Distance Monitoring with Low-resolution Infrared Sensors and Adaptive Inference

Efficient Deep Learning Models for Privacy-preserving People Counting on Low-resolution Infrared Arrays

HW-SW Optimization of DNNs for Privacy-preserving People Counting on Low-resolution Infrared Arrays

Human Activity Recognition with Low-Resolution Infrared Array Sensor Using Semi-supervised Cross-domain Neural Networks for Indoor Environment

Interpretable Passive Multi-Modal Sensor Fusion for Human Identification and Activity Recognition

Activity Recognition in Residential Spaces with Internet of Things Devices and Thermal Imaging

Privacy-Preserving Action Recognition for Smart Hospitals using Low-Resolution Depth Images

Privacy-Preserving in-bed pose monitoring: A fusion and reconstruction study

AI-driven behavior biometrics framework for robust human activity recognition in surveillance systems

PALMAR: Towards Adaptive Multi-inhabitant Activity Recognition in Point-Cloud Technology