Abstract:Sensor-based human activity recognition (HAR) has been an active research area, owing to its applications in smart environments, assisted living, fitness, healthcare, etc. Recently, deep learning based end-to-end training has resulted in state-of-the-art performance in domains such as computer vision and natural language, where large amounts of annotated data are available. However, large quantities of annotated data are not available for sensor-based HAR. Moreover, the real-world settings on which the HAR is performed differ in terms of sensor modalities, classification tasks, and target users. To address this problem, transfer learning has been employed extensively. In this survey, we focus on these transfer learning methods in the application domains of smart home and wearables-based HAR. In particular, we provide a problem-solution perspective by categorizing and presenting the works in terms of their contributions and the challenges they address. We also present an updated view of the state-of-the-art for both application domains. Based on our analysis of 205 papers, we highlight the gaps in the literature and provide a roadmap for addressing them. This survey provides a reference to the HAR community, by summarizing the existing works and providing a promising research agenda.

What problem does this paper attempt to address?

The paper primarily explores the application of transfer learning methods in the field of Human Activity Recognition (HAR) to address issues of data scarcity and generalization capability. Specifically, the paper focuses on HAR in two application scenarios: smart home environments and wearable devices, and provides a comprehensive review and analysis of related literature. ### Main Issues 1. **Data Scarcity**: Compared to fields like computer vision and natural language processing, the HAR field lacks large annotated datasets. This is because the process of collecting and annotating sensor data is more complex and costly. 2. **Generalization Capability**: The application scenarios of HAR are diverse, including differences in sensor types, classification tasks, and target users, making it difficult for a single model to be directly applied in different environments. ### Solutions Through a literature review, the paper systematically introduces how transfer learning methods can be used to solve the above issues and presents the following contributions: - **Background Introduction**: Provides new researchers entering the HAR field with basic knowledge about human activities and sensors, as well as the basic concepts of transfer learning. - **Literature Classification**: From the perspectives of smart homes and wearable devices, over 205 papers are classified, summarizing the specific challenges addressed and the methods adopted based on these papers. - **Current Status Analysis**: Lists the latest research achievements in transfer learning within the fields of smart homes and wearable devices, summarizing the challenges addressed, innovative methods adopted, comparative experiments conducted, and performance results achieved. - **Future Directions**: Based on the literature review and analysis of the latest achievements, identifies gaps in current research and proposes a clear research path aimed at guiding future research to focus on unresolved challenges and potentially effective methods. Through these contributions, the paper not only provides a comprehensive reference framework for the HAR community but also offers valuable guidance for advancing HAR technology.

Transfer Learning in Human Activity Recognition: A Survey

Overview of Human Activity Recognition Using Sensor Data

Continual learning in sensor-based human activity recognition: An empirical benchmark analysis

Human Activity Recognition using Inertial, Physiological and Environmental Sensors: a Comprehensive Survey

A Comprehensive Methodological Survey of Human Activity Recognition Across Divers Data Modalities

Lifelong Learning in Sensor-Based Human Activity Recognition

Past, Present, and Future of Sensor-based Human Activity Recognition using Wearables: A Surveying Tutorial on a Still Challenging Task

Deep Reinforcement Learning in Human Activity Recognition: A Survey and Outlook

Transfer Learning for Human Activity Recognition using Representational Analysis of Neural Networks

RecurrentHAR: A Novel Transfer Learning-Based Deep Learning Model for Sequential, Complex, Concurrent, Interleaved, and Heterogeneous Type Human Activity Recognition

Online Continual Learning for Human Activity Recognition

Cross-Domain HAR: Few Shot Transfer Learning for Human Activity Recognition

Wearable Sensor-Based Human Activity Recognition in the Smart Healthcare System

The State-of-the-Art Sensing Techniques in Human Activity Recognition: A Survey

Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities

A perspective on human activity recognition from inertial motion data

Human activity recognition with smartphone-integrated sensors: A survey

Deep, Convolutional, and Recurrent Models for Human Activity Recognition using Wearables

Deep Learning for Sensor-based Activity Recognition: A Survey

An Overview of Human Activity Recognition Using Wearable Sensors: Healthcare and Artificial Intelligence

Comprehensive machine and deep learning analysis of sensor-based human activity recognition