XHAR: Deep Domain Adaptation for Human Activity Recognition with Smart Devices

Zhijun Zhou,Yingtian Zhang,Xiaojing Yu,Panlong Yang,Xiang-Yang Li,Jing Zhao,Hao Zhou
DOI: https://doi.org/10.1109/secon48991.2020.9158431
2020-01-01
Abstract:To further improve the convenience and effectiveness of human computer interaction (HCI) with smart devices, human activity recognition (HAR) has been widely studied from various aspects. Unfortunately, deep learning based methods often suffer from either expensive labeling efforts or weak generalization ability. Inspired by recently developed domain adaptation strategies, we propose XHAR, a novel adversarial deep domain adaptation framework for HAR using smart devices, providing better device and user adaptation. XHAR first selects the most similar source dataset (with label), then extracts device and user independent spatial-temporal features through the combinations of Convolutional Neural Networks (CNN) and Bidirectional Gated Recurrent Units (BiGRU) feature extractors. Moreover, it removes the distribution discrepancy using multiple domain discriminators, and finally performs adaptation on the target dataset (without label) to obtain the predicted labels. We conduct extensive experiments on 50 users (i.e., of different ages, genders, and body shapes) and 4 smart devices with two kinds of datasets (i.e., gesture activities and sport activities). We compare our method with the source-only model and several state-of-theart domain adaptation models. The results show that XHAR increases the classification accuracy by at least 4.81% (to 74.50%) on the adaptation between different users, and accordingly by at least 9.25% (to 69.23%) between different devices.
What problem does this paper attempt to address?