Abstract:Approximately 37 million falls occur each year worldwide requiring medical attention. Victims are often helpless and not able to call for help, which is a risk for elderly persons living alone. To detect falls at home, several approaches have been proposed. Video cameras are used increasingly. Recently, high accuracy in real-time human pose estimation in videos has been achieved by novel machine learning techniques. In this work, we propose a multi-camera system for video-based fall detection. We augment human pose estimation (OpenPifPaf algorithm) by support for multi-camera and multi-person tracking and a long short-term memory (LSTM) neural network to predict two classes: “Fall” or “No Fall”. From the poses, we extract five temporal and spatial features which are processed by the LSTM. For evaluation of identification and tracking with multiple cameras, we used videos recorded in a smart home (living lab) with two persons walking and interacting. For evaluation of fall detection, we used the UP-Fall Detection dataset and achieve an F1 score of 92.5%. We observed a tendency towards false positive classifications due to lack of activities in publicly available datasets that look similar to falls but stem from normal activity. Moreover, the lack of variation in the activities also results in a higher amount of false positives. This requires the acquisition of more balanced datasets in future work. In conclusion, real-time fall detection from multiple camera inputs and for multiple persons is feasible using a LSTM neural network combined with features obtained via human pose estimation. Source code is available at https://github.com/taufeeque9/HumanFallDetection.

Transformer-based fall detection in videos

Computer Vision Based Transfer Learning-Aided Transformer Model for Fall Detection and Prediction

Edge Computing Transformers for Fall Detection in Older Adults

Advancing Fall Detection Utilizing Skeletal Joint Image Representation and Deformable Layers

Video Based Fall Detection Using Human Poses

Multi-camera, multi-person, and real-time fall detection using long short term memory

Experimental Study of Long Short-Term Memory and Transformer Models for Fall Detection on Smartwatches

Collaborative Fall Detection Using a Wearable Device and a Companion Robot.

Fall detection with a non-intrusive and first-person vision approach

Patch-Transformer Network: A Wearable-Sensor-Based Fall Detection Method

Cutup and Detect: Human Fall Detection on Cutup Untrimmed Videos Using a Large Foundational Video Understanding Model

Fall Detection from Audios with Audio Transformers

Fall detection using body geometry and human pose estimation in video sequences

Human Fall Detection Using 3D Multi-Stream Convolutional Neural Networks with Fusion

Video-Based Fall Detection Using Human Pose and Constrained Generative Adversarial Network

Exploring Human Pose Estimation and the Usage of Synthetic Data for Elderly Fall Detection in Real-World Surveillance

RT-ADI: Fast Real-Time Video Representation for Multi-view Human Fall Detection.

A Study on the Application of Convolutional Neural Networks to Fall Detection Evaluated with Multiple Public Datasets

Using Deep Neural Networks for Human Fall Detection Based on Pose Estimation

Future Frame Prediction Network for Human Fall Detection in Surveillance Videos

Vision-Based Fallen Person Detection for the Elderly