Personalized human activity recognition using deep learning and edge-cloud architecture

Luay Alawneh,Mahmoud Al-Ayyoub,Ziad A. Al-Sharif,Ahmed Shatnawi
DOI: https://doi.org/10.1007/s12652-022-03752-w
IF: 3.662
2022-02-18
Journal of Ambient Intelligence and Humanized Computing
Abstract:Human activity recognition is a thriving field with many applications in several domains. It relies on well-trained artificial intelligence models to provide accurate real-time predictions of various human movements and activities. Human activity recognition utilizes various types of sensors such as video cameras, fixed motion sensors, and those found in personal smart edge devices such as accelerometers and gyroscopes. The latter sensors capture motion as time-series data, following a specific pattern for each movement. However, movements for some users may vary from these patterns, which limit the efficacy of using a generic model. This paper proposes a human activity recognition architecture that utilizes deep learning models using time-series data. It applies incremental learning for building personalized models derived from a well-trained model. The architecture uses edge devices for model prediction and the cloud for model training. Performing the prediction on edge devices reduces the network overhead as well as the load on the cloud. We tested our approach on a publicly available dataset containing samples for daily living activities and fall states. The results show that building a personalized model from a well-trained model significantly improves the prediction accuracy. Moreover, deploying a light version of the model on edge devices maintains prediction accuracy and provides comparable response times to the original model on the cloud.
computer science, information systems,telecommunications, artificial intelligence
What problem does this paper attempt to address?