Abstract:Approximately 37 million falls occur each year worldwide requiring medical attention. Victims are often helpless and not able to call for help, which is a risk for elderly persons living alone. To detect falls at home, several approaches have been proposed. Video cameras are used increasingly. Recently, high accuracy in real-time human pose estimation in videos has been achieved by novel machine learning techniques. In this work, we propose a multi-camera system for video-based fall detection. We augment human pose estimation (OpenPifPaf algorithm) by support for multi-camera and multi-person tracking and a long short-term memory (LSTM) neural network to predict two classes: “Fall” or “No Fall”. From the poses, we extract five temporal and spatial features which are processed by the LSTM. For evaluation of identification and tracking with multiple cameras, we used videos recorded in a smart home (living lab) with two persons walking and interacting. For evaluation of fall detection, we used the UP-Fall Detection dataset and achieve an F1 score of 92.5%. We observed a tendency towards false positive classifications due to lack of activities in publicly available datasets that look similar to falls but stem from normal activity. Moreover, the lack of variation in the activities also results in a higher amount of false positives. This requires the acquisition of more balanced datasets in future work. In conclusion, real-time fall detection from multiple camera inputs and for multiple persons is feasible using a LSTM neural network combined with features obtained via human pose estimation. Source code is available at https://github.com/taufeeque9/HumanFallDetection.

Multiple States Fall Detection System for Senior Citizens

Deep Learning Based Abnormal Behavior Detection for Elderly Healthcare Using Consumer Network Cameras

A Real-time Fall Detection System Using ToF Depth Images.

Collaborative Fall Detection Using a Wearable Device and a Companion Robot.

Fall Detection in Multi-Camera Surveillance Videos

Fall Detection System Based on Deep Learning and Image Processing in Cloud Environment

Video-based Fall Detection for Seniors with Human Pose Estimation

Elderly Fall Detection Based on GCN-LSTM Multi-Task Learning Using Nursing Aids Integrated with Multi-Array Flexible Tactile Sensors

Multi-camera, multi-person, and real-time fall detection using long short term memory

A Novel Multi-Cue Integration System for Efficient Human Fall Detection

Fall Detection in Elderly Care System Based on Group of Pictures

Fall Detection Algorithm for the Elderly based on YOLOv5s

Fall Detection for Elderly People Using Machine Learning

Machine Learning based Human Fall Detection System

Exploring Human Pose Estimation and the Usage of Synthetic Data for Elderly Fall Detection in Real-World Surveillance

FALLNET: A Deep Learning Model for Fall Detection using improved CNN-Attention-LSTM

Vision-Based Fallen Person Detection for the Elderly

Fall detection using multimodal data

Implementation of a real-time fall detection system based on hybrid threshold analysis algorithm and machine learning algorithm

Real-Time Human Fall Detection using a Lightweight Pose Estimation Technique

Fall Detection Based on Body Part Tracking Using a Depth Camera