Abstract:The International Journal of Robotics Research, Ahead of Print. Understanding human activity is a crucial aspect of developing intelligent robots, particularly in the domain of human-robot collaboration. Nevertheless, existing systems encounter challenges such as over-segmentation, attributed to errors in the up-sampling process of the decoder. In response, we introduce a promising solution: the Temporal Fusion Graph Convolutional Network. This innovative approach aims to rectify the inadequate boundary estimation of individual actions within an activity stream and mitigate the issue of over-segmentation in the temporal dimension. Moreover, systems leveraging human activity recognition frameworks for decision-making necessitate more than just the identification of actions. They require a confidence value indicative of the certainty regarding the correspondence between observations and training examples. This is crucial to prevent overly confident responses to unforeseen scenarios that were not part of the training data and may have resulted in mismatches due to weak similarity measures within the system. To address this, we propose the incorporation of a Spectral Normalized Residual connection aimed at enhancing efficient estimation of novelty in observations. This innovative approach ensures the preservation of input distance within the feature space by imposing constraints on the maximum gradients of weight updates. By limiting these gradients, we promote a more robust handling of novel situations, thereby mitigating the risks associated with overconfidence. Our methodology involves the use of a Gaussian process to quantify the distance in feature space. The final model is evaluated on two challenging public datasets in the field of human-object interaction recognition, that is, Bimanual Actions and IKEA Assembly datasets, and outperforms popular existing methods in terms of action recognition and segmentation accuracy as well as out-of-distribution detection.

Bilinear Programming for Human Activity Recognition with Unknown MRF Graphs

Spatio-Temporal Dynamic Inference Network for Group Activity Recognition

Structured Feature-Graph Model for Human Activity Recognition

Sensor-Based Human Activity Mining Using Dirichlet Process Mixtures of Directional Statistical Models

Monte Carlo Tree Search for Scheduling Activity Recognition

A Graph-based Approach to Human Activity Recognition

A Hierarchical Spatio-Temporal Model for Human Activity Recognition.

Improving Human Activity Recognition for Sparse Radar Point Clouds: A Graph Neural Network Model with Pre-Trained 3D Human-Joint Coordinates

Graph-Structure-Based Multigranular Belief Fusion for Human Activity Recognition.

Skeleton-based Group Activity Recognition via Spatial-Temporal Panoramic Graph

Latent Dirichlet Allocation for Unsupervised Activity Analysis on an Autonomous Mobile Robot

Human Activity Recognition based on Dynamic Spatio-Temporal Relations

Graph-based Sparse Coding and Embedding for Activity-Based Human Identification

Versatile Graph Neural Networks Toward Intuitive Human Activity Understanding

3D Human Activity Recognition with Reconfigurable Convolutional Neural Networks

Sensor-based Human Activity Recognition System with a Multilayered Model Using Time Series Shapelets

Understanding human activity with uncertainty measure for novelty in graph convolutional networks

Human Activities Prediction by Learning Combinatorial Sparse Representations.

Leveraging spatio-temporal features using graph neural networks for human activity recognition

Recognizing human interactions by genetic algorithm-based random forest spatio-temporal correlation

M&M: Recognizing Multiple Co-evolving Activities from Multi-source Videos