Abstract:Human pose estimation has a variety of real-life applications, including human action recognition, AI-powered personal trainers, robotics, motion capture and augmented reality, gaming, and video surveillance. However, most current human pose estimation systems are based on RGB images, which do not seriously take into account personal privacy. Although identity-preserved algorithms are very desirable when human pose estimation is applied to scenarios where personal privacy does matter, developing human pose estimation algorithms based on identity-preserved modalities, such as thermal images concerned here, is very challenging due to the limited amount of training data currently available and the fact that infrared thermal images, unlike RGB images, lack rich texture cues which makes annotating training data itself impractical. In this paper, we formulate a new task with privacy protection that lies between human detection and human pose estimation by introducing a benchmark for IPHPDT (i.e., Identity-Preserved Human Posture Detection in Thermal images). This task has a threefold novel purpose: the first is to establish an identity-preserved task with thermal images; the second is to achieve more information other than the location of persons as provided by human detection for more advanced computer vision applications; the third is to avoid difficulties in collecting well-annotated data for human pose estimation in thermal images. The presented IPHPDT dataset contains four types of human postures, consisting of 75,000 images well-annotated with axis-aligned bounding boxes and postures of the persons. Based on this well-annotated IPHPDT dataset and three state-of-the-art algorithms, i.e., YOLOF (short for You Only Look One-level Feature), YOLOX (short for Exceeding YOLO Series in 2021) and TOOD (short for Task-aligned One-stage Object Detection), we establish three baseline detectors, called IPH-YOLOF, IPH-YOLOX, and IPH-TOOD. In the experiments, three baseline detectors are used to recognize four infrared human postures, and the mean average precision can reach 70.4%. The results show that the three baseline detectors can effectively perform accurate posture detection on the IPHPDT dataset. By releasing IPHPDT, we expect to encourage more future studies into human posture detection in infrared thermal images and draw more attention to this challenging task.

Humanoid Detection Method Based on Improved HOG-SVM for Infrared Video Images

Human Detection Based on Head and Shoulder Feature in Intelligent Surveillance System

Video Based Head Detection and Tracking Surveillance System

Real-time Detection and Tracking Algorithm Based on the Color and Character of Human Face

Fast Pedestrian Detection And Tracking Based On Vibe Combined Hog-Svm Scheme

An HOG-CT Human Detector with Histogram-Based Search.

Pedestrian detection based on modified dynamic background using gaussian mixture models and hog-svm detection

A novel saliency detection framework for infrared thermal images

An Empirical Study for Human Behavior Analysis

Human Detection Method Based on Multi-Part Detector and Multi-Instance Learning

Human Detection with a Coarse-to-fine Cascade Linear SVM

Human Articulated Body Recognition Method in High-Resolution Monitoring Images

A Real-Time Human Detection System for Video.

A novel hybrid human detection system

Human Detection in Video over Large Viewpoint Changes

A Hierarchical Algorithm for Human Posture Recognition Based on Spatial and Frequency Domain Features

Identity-Preserved Human Posture Detection in Infrared Thermal Images: A Benchmark

Wise Information Technology of Med: Human Pose Recognition in Elderly Care

Human detection and tracking using apparent features under multi-cameras with non-overlapping

Investigation of infrared dim and small target detection algorithm based on the visual saliency feature

A Synthetic Targets Detection Method For Human Millimeter-Wave Holographic Imaging System