A Causality-Aware Pattern Mining Scheme for Group Activity Recognition in a Pervasive Sensor Space

Hyunju Kim,Heesuk Son,Dongman Lee
2023-12-01
Abstract:Human activity recognition (HAR) is a key challenge in pervasive computing and its solutions have been presented based on various disciplines. Specifically, for HAR in a smart space without privacy and accessibility issues, data streams generated by deployed pervasive sensors are leveraged. In this paper, we focus on a group activity by which a group of users perform a collaborative task without user identification and propose an efficient group activity recognition scheme which extracts causality patterns from pervasive sensor event sequences generated by a group of users to support as good recognition accuracy as the state-of-the-art graphical model. To filter out irrelevant noise events from a given data stream, a set of rules is leveraged to highlight causally related events. Then, a pattern-tree algorithm extracts frequent causal patterns by means of a growing tree structure. Based on the extracted patterns, a weighted sum-based pattern matching algorithm computes the likelihoods of stored group activities to the given test event sequence by means of matched event pattern counts for group activity recognition. We evaluate the proposed scheme using the data collected from our testbed and CASAS datasets where users perform their tasks on a daily basis and validate its effectiveness in a real environment. Experiment results show that the proposed scheme performs higher recognition accuracy and with a small amount of runtime overhead than the existing schemes.
Machine Learning,Databases
What problem does this paper attempt to address?
### Problems the Paper Attempts to Solve This paper aims to address the issue of Group Activity Recognition (GAR) in ubiquitous computing environments. Specifically, it proposes a causal-aware pattern mining scheme for efficiently recognizing group activities in pervasive sensor spaces. #### Main Issues: 1. **Privacy and Accessibility Issues**: Traditional HAR methods such as video surveillance or wearable sensors have privacy concerns and data collection instability. 2. **Complex Activity Recognition**: People often perform complex activities that include not only simple activities but also multiple concurrent events, which existing graphical models struggle to accurately describe. 3. **Noise Filtering in Group Activities**: In group activities, it is difficult to clearly detect the relationships between sensor events due to multiple anonymous users performing tasks simultaneously. 4. **Noise Robustness**: Existing methods have low tolerance for missing or erroneous data, leading to decreased recognition accuracy. #### Solutions: 1. **Causal Relationship Extraction**: Highlight causally related events by defining a set of causal rules and using a pattern tree algorithm to extract frequent causal patterns from event sequences. 2. **Noise Filtering**: Use a set of rules to filter out irrelevant noise events, ensuring higher accuracy of the extracted patterns. 3. **Handling Important but Infrequent Events**: Identify and retain important but infrequent events, such as changes in the state of lights and projectors, through specific methods. 4. **Pattern Matching Algorithm**: Calculate the similarity between stored group activities and a given test event sequence by matching event pattern counts based on the extracted patterns. Experimental results show that this scheme has higher recognition accuracy when dealing with missing or erroneous data and its effectiveness has been validated in real-world environments.