Abstract:Background: People living with dementia often exhibit behavioural and psychological symptoms of dementia that can put their and others' safety at risk. Existing video surveillance systems in long-term care facilities can be used to monitor such behaviours of risk to alert the staff to prevent potential injuries or death in some cases. However, these behaviours of risk events are heterogeneous and infrequent in comparison to normal events. Moreover, analysing raw videos can also raise privacy concerns. Purpose: In this paper, we present two novel privacy-protecting video-based anomaly detection approaches to detect behaviours of risks in people with dementia. Methods: We either extracted body pose information as skeletons or used semantic segmentation masks to replace multiple humans in the scene with their semantic boundaries. Our work differs from most existing approaches for video anomaly detection that focus on appearance-based features, which can put the privacy of a person at risk and is also susceptible to pixel-based noise, including illumination and viewing direction. We used anonymized videos of normal activities to train customized spatio-temporal convolutional autoencoders and identify behaviours of risk as anomalies. Results: We showed our results on a real-world study conducted in a dementia care unit with patients with dementia, containing approximately 21 h of normal activities data for training and 9 h of data containing normal and behaviours of risk events for testing. We compared our approaches with the original RGB videos and obtained a similar area under the receiver operating characteristic curve performance of 0.807 for the skeleton-based approach and 0.823 for the segmentation mask-based approach. Conclusions: This is one of the first studies to incorporate privacy for the detection of behaviours of risks in people with dementia. Our research opens up new avenues to reduce injuries in long-term care homes, improve the quality of life of residents, and design privacy-aware approaches for people living in the community.

Vision-based detection of unusual patient activity

Abnormal Behavior Detection Based on Regional Optical Flow

Video object detection for privacy-preserving patient monitoring in intensive care

Vision Based Abnormal Action Detection of Children in Wards

Estimation of Clinical Workload and Patient Activity using Deep Learning and Optical Flow

Spatio-temporal features for fast early warning of unplanned self-extubation in ICU

Depth-Weighted Detection of Behaviours of Risk in People with Dementia using Cameras

Continuous Patient Monitoring with AI: Real-Time Analysis of Video in Hospital Care Settings

Clinician and Visitor Activity Patterns in an Intensive Care Unit Room: A Study to Examine How Ambient Monitoring Can Inform the Measurement of Delirium Severity and Escalation of Care

A Lidar-based computer vision system for monitoring of patients in medical scenes

Automated Detection of Patients in Hospital Video Recordings

Violence detection in videos for an intelligent surveillance system using MoBSIFT and movement filtering algorithm

An immunological approach to raising alarms in video surveillance

Large-scale surveillance system: detection and tracking of suspicious motion patterns in crowded traffic scenes

Towards Vision-Based Smart Hospitals: A System for Tracking and Monitoring Hand Hygiene Compliance

Abnormal Activity Detection Using Pyroelectric Infrared Sensors

Violence detection in surveillance video using low-level features

Emergency Fall Incidents Detection in Assisted Living Environments Utilizing Motion, Sound, and Visual Perceptual Components

Detection of Abnormal Visual Events Via Global Optical Flow Orientation Histogram

Weakly Supervised Violence Detection in Surveillance Video

Privacy-protecting behaviours of risk detection in people with dementia using videos