Abstract:Falling is ranked highly among the threats in elderly healthcare, which promotes the development of automatic fall detection systems with extensive concern. With the fast development of the Internet of Things (IoT) and Artificial Intelligence (AI), camera vision-based solutions have drawn much attention for single-frame prediction and video understanding on fall detection in the elderly by using Convolutional Neural Network (CNN) and 3D-CNN, respectively. However, these methods hardly supervise the intermediate features with good accurate and efficient performance on edge devices, which makes the system difficult to be applied in practice. This work introduces a fast and lightweight video fall detection network based on a spatio-temporal joint-point model to overcome these hurdles. Instead of detecting fall motion by the traditional CNNs, we propose a Long Short-Term Memory (LSTM) model based on time-series joint-point features extracted from a pose extractor . We also introduce the increasingly mature RGB-D camera and propose 3D pose estimation network to further improve the accuracy of the system. We propose to apply tensor train decomposition on the model to reduce storage and computational consumption so the deployment on edge devices can to realized. Experiments are conducted to verify the proposed framework. For fall detection task, the proposed video fall detection framework achieves a high sensitivity of 98.46% on Multiple Cameras Fall, 100% on UR Fall, and 98.01% on NTU RGB-D 120. For pose estimation task, our 2D model attains 73.3 mAP in the COCO keypoint challenge, which outperforms the OpenPose by 8%. Our 3D model attains 78.6% mAP on NTU RGB-D dataset with 3.6× faster speed than OpenPose.

Future Frame Prediction Network for Human Fall Detection in Surveillance Videos

Learning Spatiotemporal Representations for Human Fall Detection in Surveillance Video.

Video-Based Fall Detection Using Human Pose and Constrained Generative Adversarial Network

A Fall Detection Network by 2D/3D Spatio-temporal Joint Models with Tensor Compression on Edge

Dilated spatial-temporal convolutional auto-encoders for human fall detection in surveillance videos

Enhanced 3D Residual Network for Human Fall Detection in Video Surveillance.

Human fall detection in surveillance video based on PCANet

Video Based Fall Detection Using Human Poses

Human Fall Detection Model with Lightweight Network and Tracking in Video

Human Fall Detection Using Spatial Temporal Graph Convolution

A Real-time Fall Detection System Using ToF Depth Images.

Falls Prediction Based on Body Keypoints and Seq2Seq Architecture

A Spatio-Temporal Graph Neural Network for Fall Prediction with Inertial Sensors

Human Fall Detection Using 3D Multi-Stream Convolutional Neural Networks with Fusion

Multi-camera, multi-person, and real-time fall detection using long short term memory

AMDNet: Adaptive Fall Detection Based on Multi-scale Deformable Convolution Network.

Robust Fall Detection in Video Surveillance Based on Weakly Supervised Learning

Human Fall Detection Based on Re-Parameterization and Feature Enhancement

Video Recognition of Human Fall Based on Spatiotemporal Features

FALLNET: A Deep Learning Model for Fall Detection using improved CNN-Attention-LSTM

Visual Surveillance for Human Fall Detection in Healthcare IoT