Abstract:Falling down is a serious problem for health and has become one of the major etiologies of accidental death for the elderly living alone. In recent years, many efforts have been paid to fall recognition based on wearable sensors or standard vision sensors. However, the prior methods have the risk of privacy leaks, and almost all these methods are based on video clips, which cannot localize where the falls occurred in long videos. For these reasons, in this article, the bioinspired vision sensor-based falls temporal localization framework is proposed. The bioinspired vision sensors, such as dynamic and active-pixel vision sensor (DAVIS) camera applied in this work responds to pixels' brightness change, and each pixel works independently and asynchronously compared to the standard vision sensors. This property makes it have a very high dynamic range and privacy preserving. First, to better represent event data, compared with the typical constant temporal window mechanism, an adaptive temporal window conversion mechanism is developed. The temporal localization framework follows a proven proposal and classification paradigm. Second, for the high-efficient and recall proposal generation, different from the traditional sliding window scheme, the event temporal density as the actionness score is set and the 1D-watershed algorithm to generate proposals is applied. In addition, we combine the temporal and spatial attention mechanism with our feature extraction network to temporally model the falls. Finally, to evaluate the performance of our framework, 30 volunteers are recruited to join the simulated fall experiments. According to the results of experiments, our framework can realize precise falls temporal localization and achieve the state-of-the-art performance.

Predicting Fall Events by a Spatio-Temporal Topological Network with Multiple Wearable Sensors.

A Spatio-Temporal Graph Neural Network for Fall Prediction with Inertial Sensors

MCTN: A Multi-Channel Temporal Network for Wearable Fall Prediction

Fall Prediction by a Spatio-Temporal Multi-Channel Causal Model from Wearable Sensors Data.

Human Fall Detection Based on Body Posture Spatio-Temporal Evolution

A Real-time Fall Detection System Using ToF Depth Images.

Human Fall Detection Improvement Based on Artificial Neural Network and Optimized Zero Moment Point Algorithms

Neuromorphic Vision-Based Fall Localization in Event Streams With Temporal–Spatial Attention Weighted Network

A Fall Detection Network by 2D/3D Spatio-temporal Joint Models with Tensor Compression on Edge

Skeleton-Based Fall Detection with Multiple Inertial Sensors Using Spatial-Temporal Graph Convolutional Networks

Human Fall Detection Using Spatial Temporal Graph Convolution

Development of a Strategy to Predict and Detect Falls Using Wearable Sensors

Prediction of fall risk among community-dwelling older adults using a wearable system

MhNet: Multi-scale Spatio-Temporal Hierarchical Network for Real-Time Wearable Fall Risk Assessment of the Elderly

Human Fall Detection Model with Lightweight Network and Tracking in Video

A Real-Time Fall Detection Model Based on BlazePose and Improved ST-GCN

Patch-Transformer Network: A Wearable-Sensor-Based Fall Detection Method

Fall prediction based on biomechanics equilibrium using Kinect

Fall-LSTM: A Fall Detection Network Based on Spatio-Temporal Location Module

Falls Prediction Based on Body Keypoints and Seq2Seq Architecture