Abstract:The prevention of falls has become crucial in the modern healthcare domain and in society for improving ageing and supporting the daily activities of older people. Falling is mainly related to age and health problems such as muscle, cardiovascular, and locomotive syndrome weakness, etc. Among elderly people, the number of falls is increasing every year, and they can become life-threatening if detected too late. Most of the time, ageing people consume prescription medication after a fall and, in the Japanese community, the prevention of suicide attempts due to taking an overdose is urgent. Many researchers have been working to develop fall detection systems to observe and notify about falls in real-time using handcrafted features and machine learning approaches. Existing methods may face difficulties in achieving a satisfactory performance, such as limited robustness and generality, high computational complexity, light illuminations, data orientation, and camera view issues. We proposed a graph-based spatial-temporal convolutional and attention neural network (GSTCAN) with an attention model to overcome the current challenges and develop an advanced medical technology system. The spatial-temporal convolutional system has recently proven the power of its efficiency and effectiveness in various fields such as human activity recognition and text recognition tasks. In the procedure, we first calculated the motion along the consecutive frame, then constructed a graph and applied a graph-based spatial and temporal convolutional neural network to extract spatial and temporal contextual relationships among the joints. Then, an attention module selected channel-wise effective features. In the same procedure, we repeat it six times as a GSTCAN and then fed the spatial-temporal features to the network. Finally, we applied a softmax function as a classifier and achieved high accuracies of 99.93%, 99.74%, and 99.12% for ImViA, UR-Fall, and FDD datasets, respectively. The high-performance accuracy with three datasets proved the proposed system's superiority, efficiency, and generality.

Real-Time Human Falling Recognition Via Spatial and Temporal Self-Attention Augmented Graph Convolutional Network.

Fall Detection Method for Infrared Videos Based on Spatial-Temporal Graph Convolutional Network

Human Fall Detection Using Spatial Temporal Graph Convolution

Skeleton-Based Fall Detection with Multiple Inertial Sensors Using Spatial-Temporal Graph Convolutional Networks

A Real-Time Fall Detection Model Based on BlazePose and Improved ST-GCN

A Real-time Fall Detection System Using ToF Depth Images.

Human Fall Detection Model with Lightweight Network and Tracking in Video

A Spatio-Temporal Graph Neural Network for Fall Prediction with Inertial Sensors

Learning Spatiotemporal Representations for Human Fall Detection in Surveillance Video.

S3D-CNN: Skeleton-Based 3D Consecutive-Low-pooling Neural Network for Fall Detection

Worker Abnormal Behavior Recognition Based on Spatio-Temporal Graph Convolution and Attention Model

Human Fall Detection Based on Body Posture Spatio-Temporal Evolution

Skeleton Based Fall Detection with Convolutional Neural Network

Fall Detection and Activity Recognition Using Human Skeleton Features

A Fall Detection Method in Elevators Based on Graph Convolutional Networks

Neuromorphic Vision-Based Fall Localization in Event Streams With Temporal–Spatial Attention Weighted Network

Dynamic Fall Detection Using Graph-Based Spatial Temporal Convolution and Attention Network

Computer-Aided Fall Recognition Using a Three-Stream Spatial-Temporal GCN Model with Adaptive Feature Aggregation

FALLNET: A Deep Learning Model for Fall Detection using improved CNN-Attention-LSTM

A Novel Vision-Based Fall Detection Scheme Using Keypoints of Human Skeleton with Long Short-Term Memory Network