A Real-Time Fall Detection Model Based on BlazePose and Improved ST-GCN

Yu Zhang,Junsi Gan,Zewei Zhao,Junliang Chen,Xiaofeng Chen,Yinliang Diao,Shuqin Tu
DOI: https://doi.org/10.1007/s11554-023-01377-6
IF: 2.293
2023-01-01
Journal of Real-Time Image Processing
Abstract:Providing timely rescue when a fall occurs can greatly reduce fall mortality for older people. With the growing number of single-resided elders, real-time smart fall incident detection has become a new research hotspot. Accuracy, computational complexity and real-time response are key issues to be solved in this topic. A fall detection model that combines an improved Spatial–Temporal Graph Convolutional Network (ST-GCN) with the BlazePose algorithm is proposed in this paper. The computational speed is improved by removing four redundant layers from the ST-GCN network. Meanwhile, an attention mechanism focussing on the key joints involved in the falling action and their correlation is applied in the model, which introduces an Effective SE Block (ESE Block) to the residual structure of ST-GCN. It is achieved by fusing the original features with channel attention weights obtained by global average pooling and fully connected operations for the joint features. The BlazePose algorithm of the mediapipe framework is used to recognise human targets and locate the spatial coordinates of specific joints. Then the spatiotemporal graph features of the human body are extracted by the improved ST-GCN from the temporal and spatial displacements of 30 consecutive frames. Furthermore, fall behaviour is judged by the action type defined by the spatiotemporal graph. The accuracy of the proposed model for public datasets, such as Le2i Fall, Multicam Fall and UR Fall, is 99.29
What problem does this paper attempt to address?