Abstract:The prevention of falls has become crucial in the modern healthcare domain and in society for improving ageing and supporting the daily activities of older people. Falling is mainly related to age and health problems such as muscle, cardiovascular, and locomotive syndrome weakness, etc. Among elderly people, the number of falls is increasing every year, and they can become life-threatening if detected too late. Most of the time, ageing people consume prescription medication after a fall and, in the Japanese community, the prevention of suicide attempts due to taking an overdose is urgent. Many researchers have been working to develop fall detection systems to observe and notify about falls in real-time using handcrafted features and machine learning approaches. Existing methods may face difficulties in achieving a satisfactory performance, such as limited robustness and generality, high computational complexity, light illuminations, data orientation, and camera view issues. We proposed a graph-based spatial-temporal convolutional and attention neural network (GSTCAN) with an attention model to overcome the current challenges and develop an advanced medical technology system. The spatial-temporal convolutional system has recently proven the power of its efficiency and effectiveness in various fields such as human activity recognition and text recognition tasks. In the procedure, we first calculated the motion along the consecutive frame, then constructed a graph and applied a graph-based spatial and temporal convolutional neural network to extract spatial and temporal contextual relationships among the joints. Then, an attention module selected channel-wise effective features. In the same procedure, we repeat it six times as a GSTCAN and then fed the spatial-temporal features to the network. Finally, we applied a softmax function as a classifier and achieved high accuracies of 99.93%, 99.74%, and 99.12% for ImViA, UR-Fall, and FDD datasets, respectively. The high-performance accuracy with three datasets proved the proposed system's superiority, efficiency, and generality.

Spatio-temporal Fall Event Detection in Complex Scenes Using Attention Guided LSTM

Vision-Based Fall Event Detection in Complex Background Using Attention Guided Bi-directional LSTM

Pedestrian Fall Event Detection in Complex Scenes Based on Attention-Guided Neural Network

Fall-LSTM: A Fall Detection Network Based on Spatio-Temporal Location Module

Visual Guided Deep Learning Scheme for Fall Detection

A Real-time Fall Detection System Using ToF Depth Images.

Neuromorphic Vision-Based Fall Localization in Event Streams With Temporal–Spatial Attention Weighted Network

Learning Spatiotemporal Representations for Human Fall Detection in Surveillance Video.

FALLNET: A Deep Learning Model for Fall Detection using improved CNN-Attention-LSTM

Deep Learning for Fall Detection: Three-Dimensional CNN Combined With LSTM on Video Kinematic Data

Human Fall Detection Based on Body Posture Spatio-Temporal Evolution

Integrating attention mechanism and multi-scale feature extraction for fall detection

Fall Detection with CNN-Casual LSTM Network

A Spatio-Temporal Graph Neural Network for Fall Prediction with Inertial Sensors

A Fall Detection Network by 2D/3D Spatio-temporal Joint Models with Tensor Compression on Edge

Human Fall Detection Using Spatial Temporal Graph Convolution

Dynamic Fall Detection Using Graph-Based Spatial Temporal Convolution and Attention Network

Fall Detection Method for Infrared Videos Based on Spatial-Temporal Graph Convolutional Network

Dilated spatial-temporal convolutional auto-encoders for human fall detection in surveillance videos

Video-Based Fall Detection Using Human Pose and Constrained Generative Adversarial Network