Subject-Adaptive Loose-Fitting Smart Garment Platform for Human Activity Recognition
Qi Lin,Shuhua Peng,Yuezhong Wu,Jun Liu,Hong Jia,Wen Hu,Mahbub Hassan,Aruna Seneviratne,Chun H Wang
DOI: https://doi.org/10.1145/3584986
2023-02-20
ACM Transactions on Sensor Networks
Abstract:The ability to recognize and detect changes in human posture is important in a wide range of applications such as health care and human-computer-interaction. Achieving this goal using loose-fit garments instrumented with sensors is particularly challenging, due to the complex interaction between garments and human body. Herein, we present a method to detect and recognize human posture with casual loose-fitting smart garments integrated with highly sensitive, stretchable, optical transparent and low-cost strain sensors. By attaching these sensors to an off-the-shelf casual jacket, we developed a smart loose-fitting sensing garment, which enables posture recognition using a deep learning model, domain-adaptive CNN-LSTM. This deep learning model overcame the noise and variation due to the complex interaction between loose-fitting garments and human body. Considering that users’ labeled data are usually not available in the training stage, an additional domain discriminator path on the conventional CNN-LSTM model has been introduced to further improve the adaptability. To evaluate the potential of this loose-fitting smart garment, three case studies were conducted under realistic conditions: recognitions of human activities, stationary postures with random hand movements and slouch. Our results demonstrate the potential of the proposed smart garment system for practical applications.
computer science, information systems,telecommunications