Abstract:Humans achieve cognitive development through continuous interaction with their environment, enhancing both perception and behavior. However, current robots lack the capacity for human-like action and evolution, posing a bottleneck to improving robotic intelligence. Existing research predominantly models robots as one-way, static mappings from observations to actions, neglecting the dynamic processes of perception and behavior. This paper introduces a novel approach to robot cognitive learning by considering physical properties. We propose a theoretical framework wherein a robot is conceptualized as a three-body physical system comprising a perception-body (P-body), a cognition-body (C-body), and a behavior-body (B-body). Each body engages in physical dynamics and operates within a closed-loop interaction. Significantly, three crucial interactions connect these bodies. The C-body relies on the P-body’s extracted states and reciprocally offers long-term rewards, optimizing the P-body’s perception policy. In addition, the C-body directs the B-body’s actions through sub-goals, and subsequent P-body-derived states facilitate the C-body’s cognition dynamics learning. At last, the B-body would follow the sub-goal generated by the C-body and perform actions conditioned on the perceptive state from the P-body, which leads to the next interactive step. These interactions foster the joint evolution of each body, culminating in optimal design. To validate our approach, we employ a navigation task using a four-legged robot, D’Kitty, equipped with a movable global camera. Navigational prowess demands intricate coordination of sensing, planning, and D’Kitty’s motion. Leveraging our framework yields superior task performance compared with conventional methodologies. In conclusion, this paper establishes a paradigm shift in robot cognitive learning by integrating physical interactions across the P-body, C-body, and B-body, while considering physical properties. Our framework’s successful application to a navigation task underscores its efficacy in enhancing robotic intelligence.

Learning and Reuse of Experience in Behavior-Based Service Robots

Adapting Home Service Robot Behaviors by Experience Reuse and Interaction with Humans

Perception-enhancement Based Task Learning and Action Scheduling for Robotic Limb in CPS Environment

Multi-style Learning for Adaptation of Perception Intelligence in Home Service Robots

Learning-from-Observation System Considering Hardware-Level Reusability

Behavior-Based Assistive Robotics for the Home

Learning and Adapting Agile Locomotion Skills by Transferring Experience

Learning Physical Collaborative Robot Behaviors From Human Demonstrations

Interactive Continual Learning Architecture for Long-Term Personalization of Home Service Robots

Learning Skills from Demonstrations: A Trend from Motion Primitives to Experience Abstraction

Robot Cognitive Learning by Considering Physical Properties

Mixed-Reality Robot Behavior Replay: A System Implementation

STUDY OF BEHAVIOR LEARNING FOR AUTONOMOUS ROBOT UNDER UNKNOWN ENVIRONMENT

Learning to Share Autonomy Across Repeated Interaction

A psychology based approach for longitudinal development in cognitive robotics

Learning and Control in Assistive Robotics for the Elderly

Interactive Robot Learning from Verbal Correction

Simultaneously learning intentions and preferences during physical human-robot cooperation

Designing Library of Skill-Agents for Hardware-Level Reusability

A Framework for Learning and Reusing Robotic Skills

Learning from demonstrations: An intuitive VR environment for imitation learning of construction robots