Abstract:Human-system interactions frequently require a retrieval of the key context information about the user and the environment. Image processing techniques have been widely applied in this area, providing details about recognized objects, people and actions. Considering remote diagnostics solutions, e.g. non-contact vital signs estimation and smart home monitoring systems that utilize person's identity, security is a very important factor. Thus, thermal imaging has become more and more popular, as it does not reveal features that are often used for person recognition, i.e. sharp edges, clear changes of pixel values between areas, etc. On the other hand, there are much more visible light data available for deep model training. Taking it into account, person recognition from thermography is much more challenging due to specific characteristics (blurring and smooth representation of features) and small amount of training data. Moreover, when low resolution data is used, features become even less visible, so this problem may become more difficult. This study focuses on verifying whether model trained to extract important facial embedding from RGB images can perform equally well if applied to thermal domain, without additional re-training. We also perform a set of experiments aim at evaluating the influence of resolution degradation by down-scaling images on the recognition accuracy. In addition, we present deep super-resolution (SR) model that by enhancing donw-scaled images can improve results for data acquired in scenarios that simulate real-life environment, i.e. mimicking facial expressions and performing head motions. Preliminary results proved that in such cases SR helps to increase accuracy by 6.5% for data 8 times smaller than original images. It has also been shown that it is possible to accurately recognize even 40 volunteers using only 4 images per person as a reference embedding. Thus, the initial profiles can be easily created in a real time, what is an additional advantage considering a solution setup in a new environment.

Modeling the Trade-off of Privacy Preservation and Activity Recognition on Low-Resolution Images

Towards Privacy-Preserving Visual Recognition via Adversarial Training: A Pilot Study

Privacy-Preserving Action Recognition for Smart Hospitals using Low-Resolution Depth Images

A Low-Resolution Infrared Array for Unobtrusive Human Activity Recognition That Preserves Privacy

Understanding Visual Privacy Protection: A Generalized Framework With an Instance on Facial Privacy

Privacy-preserving Activity Recognition Using Multimodal Sensors in Smart Office

High Resolution Face Privacy-Enhancing Method Based on Latent Optimization with Identity-Preserving Facial Masking

Efficient Task-driven Video Data Privacy Protection for Smart Camera Surveillance System

Balancing Privacy and Accuracy: Exploring the Impact of Data Anonymization on Deep Learning Models in Computer Vision

Visual Content Privacy Protection: A Survey

Energy-efficient and Privacy-aware Social Distance Monitoring with Low-resolution Infrared Sensors and Adaptive Inference

Influence of Thermal Imagery Resolution on Accuracy of Deep Learning based Face Recognition

Protection of visual privacy in videos acquired with RGB cameras for active and assisted living applications

Transferable Adversarial Facial Images for Privacy Protection

Enhancing User-Centric Privacy Protection: An Interactive Framework through Diffusion Models and Machine Unlearning

Enable Portrait Privacy Protection in Photo Capturing and Sharing

Explaining models relating objects and privacy

Efficient Deep Learning Models for Privacy-preserving People Counting on Low-resolution Infrared Arrays

Reconciling privacy and accuracy in AI for medical imaging

Privacy-preserving Social Distance Monitoring on Microcontrollers with Low-Resolution Infrared Sensors and CNNs

Privacy-Preserving Cross-Environment Human Activity Recognition