Abstract:Falling down is a serious problem for health and has become one of the major etiologies of accidental death for the elderly living alone. In recent years, many efforts have been paid to fall recognition based on wearable sensors or standard vision sensors. However, the prior methods have the risk of privacy leaks, and almost all these methods are based on video clips, which cannot localize where the falls occurred in long videos. For these reasons, in this article, the bioinspired vision sensor-based falls temporal localization framework is proposed. The bioinspired vision sensors, such as dynamic and active-pixel vision sensor (DAVIS) camera applied in this work responds to pixels' brightness change, and each pixel works independently and asynchronously compared to the standard vision sensors. This property makes it have a very high dynamic range and privacy preserving. First, to better represent event data, compared with the typical constant temporal window mechanism, an adaptive temporal window conversion mechanism is developed. The temporal localization framework follows a proven proposal and classification paradigm. Second, for the high-efficient and recall proposal generation, different from the traditional sliding window scheme, the event temporal density as the actionness score is set and the 1D-watershed algorithm to generate proposals is applied. In addition, we combine the temporal and spatial attention mechanism with our feature extraction network to temporally model the falls. Finally, to evaluate the performance of our framework, 30 volunteers are recruited to join the simulated fall experiments. According to the results of experiments, our framework can realize precise falls temporal localization and achieve the state-of-the-art performance.

Pedestrian Fall Event Detection in Complex Scenes Based on Attention-Guided Neural Network

Pedestrian Detection Method Based on Improved YOLOv5s for Densely Occluded Scenarios

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

Vision-Based Fall Event Detection in Complex Background Using Attention Guided Bi-directional LSTM

A Real-time Fall Detection System Using ToF Depth Images.

Human Fall Detection Based on Re-Parameterization and Feature Enhancement

Research on Deep Learning Detection Model for Pedestrian Objects in Complex Scenes Based on Improved YOLOv7

An Efficient Pedestrian Detection for Realtime Surveillance Systems Based on Modified YOLOv3

Pedestrian Detection in Complex Scene Using Full Binary Tree Classifiers Based on Locally Assembled Binary Haar-Like Features

FALLNET: A Deep Learning Model for Fall Detection using improved CNN-Attention-LSTM

Human Fall Detection Model with Lightweight Network and Tracking in Video

Integrating attention mechanism and multi-scale feature extraction for fall detection

A Pedestrian Target Detection Network Based on Attention Mechanism and Multi-scale Feature Fusion

A Lightweight Vehicle-Pedestrian Detection Algorithm Based on Attention Mechanism in Traffic Scenarios

A Novel Multi-Cue Integration System for Efficient Human Fall Detection

Attention-Guided Sample-Based Feature Enhancement Network for Crowded Pedestrian Detection Using Vision Sensors

A pedestrian detection algorithm based on deep learning

Fast Pedestrian Detection with Attention-Enhanced Multi-Scale RPN and Soft-Cascaded Decision Trees

YOLOv8-based Dense Pedestrian Detection Algorithm

Mask-Guided Attention Network for Occluded Pedestrian Detection

Neuromorphic Vision-Based Fall Localization in Event Streams With Temporal–Spatial Attention Weighted Network