Recognizing Human-object Interactions for a Home Assistive Robot

Liangliang Wang,Guanglei Huo,Xinwei Chen,Chengxi Huang
DOI: https://doi.org/10.1109/cacre58689.2023.10208873
2023-01-01
Abstract:To enable robots to understand a specific assistive task during human-robot interactions under complex home scenes, at the center is the problem of human-object interaction (HOI) recognition. In particular, aiming at identifying efficiently, this paper proposes a graph convolutional network (GCN) by considering the similarity and proximity of human and object nodes, based on which the geometric positions and morphological relationships are explored. Also, a supplementary convolutional neural network (CNN) is fused to GCN to extract the global semantic features, which also ensures the recognition applicability for the cases where detectors fall into failure. Experiments on V-COCO demonstrate our approach, and results in real-world scenes on our assistive robot – Xiaozhi II verify its robustness.
What problem does this paper attempt to address?