Interactive Continual Learning Architecture for Long-Term Personalization of Home Service Robots

Ali Ayub,Chrystopher Nehaniv,Kerstin Dautenhahn

2024-03-06

Abstract:For robots to perform assistive tasks in unstructured home environments, they must learn and reason on the semantic knowledge of the environments. Despite a resurgence in the development of semantic reasoning architectures, these methods assume that all the training data is available a priori. However, each user's environment is unique and can continue to change over time, which makes these methods unsuitable for personalized home service robots. Although research in continual learning develops methods that can learn and adapt over time, most of these methods are tested in the narrow context of object classification on static image datasets. In this paper, we combine ideas from continual learning, semantic reasoning, and interactive machine learning literature and develop a novel interactive continual learning architecture for continual learning of semantic knowledge in a home environment through human-robot interaction. The architecture builds on core cognitive principles of learning and memory for efficient and real-time learning of new knowledge from humans. We integrate our architecture with a physical mobile manipulator robot and perform extensive system evaluations in a laboratory environment over two months. Our results demonstrate the effectiveness of our architecture to allow a physical robot to continually adapt to the changes in the environment from limited data provided by the users (experimenters), and use the learned knowledge to perform object fetching tasks.

Robotics,Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is achieving long - term personalization in home service robots. Specifically, the paper focuses on how robots can learn and reason about the semantic knowledge of the environment when performing assistive tasks in unstructured home environments. However, each user's environment is unique and changes over time, which makes existing methods (assuming all training data are pre - available) not suitable for personalized home service robots. Although research in Continual Learning (CL) has developed methods that can learn and adapt over time, most of these methods have only been tested on narrow object - classification static - image datasets. Therefore, the paper proposes a new Interactive Continual Learning (ICL) architecture, aiming to continuously learn semantic knowledge in home environments through human - machine interaction. This architecture combines ideas from the fields of continual learning, semantic reasoning, and interactive machine learning, and can perform efficient real - time learning with limited data, thereby allowing physical robots to self - adjust according to environmental changes and use the learned knowledge to complete tasks such as object grasping.

Interactive Continual Learning Architecture for Long-Term Personalization of Home Service Robots

Continual Learning through Human-Robot Interaction -- Human Perceptions of a Continual Learning Robot in Repeated Interactions

Towards Cognitive Robots That People Accept in Their Home

Multi-style Learning for Adaptation of Perception Intelligence in Home Service Robots

CLFR-M: Continual Learning Framework for Robots Via Human Feedback and Dynamic Memory

Elder-oriented Active Learning for Adaptation of Perception Intelligence in Home Service Robots

Evaluating Continual Learning on a Home Robot

Perception-enhancement Based Task Learning and Action Scheduling for Robotic Limb in CPS Environment

A Personalized Household Assistive Robot that Learns and Creates New Breakfast Options through Human-Robot Interaction

Learning and Development of Home Service Robots' Service Cognition Based on a Learning Mechanism

A Cloud-based Robot System for Long-term Interaction: Principles, Implementation, Lessons Learned

A Novel Continuous Learning and Collaborative Decision Making Mechanism for Real-Time Cooperation of Humanoid Service Robots

How Do Human Users Teach a Continual Learning Robot in Repeated Interactions?

Robot Cognitive Learning by Considering Physical Properties

A Self-Organizing Developmental Cognitive Architecture with Interactive Reinforcement Learning.

Learning on the Job: Long-Term Behavioural Adaptation in Human-Robot Interactions

Interactive Robot Learning from Verbal Correction

Understanding Factors that Shape Children's Long Term Engagement with an In-Home Learning Companion Robot

An End-to-End Robot Architecture to Manipulate Non-Physical State Changes of Objects

Continual Skill and Task Learning via Dialogue

Federated Continual Learning for Socially Aware Robotics