Abstract:Background: People living with dementia often exhibit behavioural and psychological symptoms of dementia that can put their and others' safety at risk. Existing video surveillance systems in long-term care facilities can be used to monitor such behaviours of risk to alert the staff to prevent potential injuries or death in some cases. However, these behaviours of risk events are heterogeneous and infrequent in comparison to normal events. Moreover, analysing raw videos can also raise privacy concerns. Purpose: In this paper, we present two novel privacy-protecting video-based anomaly detection approaches to detect behaviours of risks in people with dementia. Methods: We either extracted body pose information as skeletons or used semantic segmentation masks to replace multiple humans in the scene with their semantic boundaries. Our work differs from most existing approaches for video anomaly detection that focus on appearance-based features, which can put the privacy of a person at risk and is also susceptible to pixel-based noise, including illumination and viewing direction. We used anonymized videos of normal activities to train customized spatio-temporal convolutional autoencoders and identify behaviours of risk as anomalies. Results: We showed our results on a real-world study conducted in a dementia care unit with patients with dementia, containing approximately 21 h of normal activities data for training and 9 h of data containing normal and behaviours of risk events for testing. We compared our approaches with the original RGB videos and obtained a similar area under the receiver operating characteristic curve performance of 0.807 for the skeleton-based approach and 0.823 for the segmentation mask-based approach. Conclusions: This is one of the first studies to incorporate privacy for the detection of behaviours of risks in people with dementia. Our research opens up new avenues to reduce injuries in long-term care homes, improve the quality of life of residents, and design privacy-aware approaches for people living in the community.

Protection of visual privacy in videos acquired with RGB cameras for active and assisted living applications

STPrivacy: Spatio-Temporal Privacy-Preserving Action Recognition

Privacy-Phys: Facial Video-Based Physiological Modification for Privacy Protection

PrivHAR: Recognizing Human Actions From Privacy-preserving Lens

Towards Privacy-Preserving Visual Recognition via Adversarial Training: A Pilot Study

Efficient Task-driven Video Data Privacy Protection for Smart Camera Surveillance System

Privacy-Preserving Robot Vision with Anonymized Faces by Extreme Low Resolution

Video object detection for privacy-preserving patient monitoring in intensive care

Tools for Protecting the Privacy of Specific Individuals in Video

Privacy-Preserving Remote Heart Rate Estimation from Facial Videos

Privacy-Preserving Action Recognition for Smart Hospitals using Low-Resolution Depth Images

An Efficient Privacy Protection Scheme for Data Security in Video Surveillance.

PrivacyEye: A Privacy-Preserving and Computationally Efficient Deep Learning-Based Mobile Video Analytics System

Privacy-protecting behaviours of risk detection in people with dementia using videos

Convolutional-based variational autoencoders for face privacy protection in video surveillance

Fairly Private: Investigating The Fairness of Visual Privacy Preservation Algorithms

Improved privacy protection technique for enhancing security of real-time video surveillance

Privid: Practical, Privacy-Preserving Video Analytics Queries

Cardea: Context-Aware Visual Privacy Protection from Pervasive Cameras

Personal Privacy Protection via Irrelevant Faces Tracking and Pixelation in Video Live Streaming

Shielding Facial Physiological Information in Video.