A Unified Framework for Human-Robot Knowledge Transfer.

Nishant Shukla,Caiming Xiong,Song-Chun Zhu

2015-01-01

Abstract:Robots capable of growing knowledge and learning new tasks is of demanding interest. We formalize knowledge transfer in human-robot interactions, and establish a testing framework for it. As a proof of concept, we implement a robot system that not only learns in real-time from human demonstrations, but also transfers this knowledge.

What problem does this paper attempt to address?

A Human-Robot Collaboration System for Object Handover

Yifei Yang,Longzhong Lin,Yifan Zhang,Zhongxiang Zhou,Yue Wang,Rong Xiong

DOI: https://doi.org/10.1109/robio54168.2021.9739333

2021-01-01

Abstract:Humans and robots are the two main labor in industry, and they have respective advantages. Human-Robot Collaboration combines the advantages of humans and robots, which makes it a research hotspot. While there are a lot of research and developments in the field of Human-Robot Collaboration, how to apply and optimize existing technologies to realize a complete Human-Robot Collaboration system is not a very focused problem. So, we realize a Human-Robot Collaboration system for object handover: the human holds a container (denoted as ContainerA), and the robot holds the other container (denoted as ContainerB) with some contents as a collaborator; the robot uses computer vision to detect ContainerA and estimate position and orientation of it; then the robot plans and controls the motion of the robot arm based on the visual information, and hand over the contents in ContainerB to ContainerA. For computer vision, we use Fast- SCNN for semantic segmentation and REDE for pose estimation, which can obtain the accurate pose of the hand-held container in real time. In terms of robot arm motion planning and control, we perform speed control based on artificial potential field and admittance control to achieve a smooth follow-up movement.
A Robotic Manipulation Framework for Industrial Human–robot Collaboration Based on Continual Knowledge Graph Embedding

Bohan Feng,Xinzhe Juan,Xinyi Gao,Qi Zhou,Youyi Bi

DOI: https://doi.org/10.1007/s00170-024-14468-w

2024-01-01

Abstract:Hybrid robots can assist human workers in various tasks due to their integration of mobility and manipulability. The rapid diffusion of these robots in factories has significantly elevated the automation and intelligence level of manufacturing, while also brings challenges to human–robot collaboration. Traditionally, human workers need to instruct robots to perform a range of tasks by explicitly demonstrating these operations. However, this process imposes excessive burdens on workers as the tasks and environment for robots become more and more diversified and complex. To alleviate this issue, we propose an innovative robotic manipulation framework based on continual knowledge graph embedding. This framework enables hybrid robots to break free from the constraints of fixed rules set by human demonstrations, instead endowing them with inferring capability. The core idea is to utilize semantic information related to objects (such as category, material, and components) and tasks assigned to infer appropriate operational parameters for robots via a knowledge graph. These operational parameters include the suitable type of gripper, the proper area for object manipulation, and the reasonable force range for effective grasping. We conduct an experimental analysis of the proposed framework with a real-world hybrid robot, which performed 158 different tasks involving 46 objects commonly seen in industry, achieving a success rate of up to 96.8
Shaping in Reinforcement Learning Via Knowledge Transferred from Human-Demonstrations

Wang Guofang,Fang Zhou,Li Ping,Li Bo

DOI: https://doi.org/10.1109/chicc.2015.7260106

2015-01-01

Abstract:Transfer has been widely used to ameliorate the slow convergence speed of reinforcement learning (RL) by reusing the previous obtained knowledge from other related but distinct tasks. In this paper, we propose a framework to transfer knowledge learned directly from human-demonstration trajectories of source tasks to shape the RL algorithm in target task, so as to avoid the time-consuming training process of RL in source tasks and thus we expand the learning paradigm of transfer in RL domains. In our framework, rather than transferring the most common value function or policy, we adopt the visit frequencies of states in successful demonstration trajectories as the acquired knowledge, and then perform transfer via shared agent space. Simulation experiments in obstacle avoidance problems suggest that the transferred knowledge could accelerate the learning process in target task obviously. And as a case study, the experiments show the potential of our framework in knowledge transfer in RL tasks.
Generalized Robot Learning Framework

Jiahuan Yan,Zhouyang Hong,Yu Zhao,Yu Tian,Yunxin Liu,Travis Davies,Luhui Hu

2024-09-18

Abstract:Imitation based robot learning has recently gained significant attention in the robotics field due to its theoretical potential for transferability and generalizability. However, it remains notoriously costly, both in terms of hardware and data collection, and deploying it in real-world environments demands meticulous setup of robots and precise experimental conditions. In this paper, we present a low-cost robot learning framework that is both easily reproducible and transferable to various robots and environments. We demonstrate that deployable imitation learning can be successfully applied even to industrial-grade robots, not just expensive collaborative robotic arms. Furthermore, our results show that multi-task robot learning is achievable with simple network architectures and fewer demonstrations than previously thought necessary. As the current evaluating method is almost subjective when it comes to real-world manipulation tasks, we propose Voting Positive Rate (VPR) - a novel evaluation strategy that provides a more objective assessment of performance. We conduct an extensive comparison of success rates across various self-designed tasks to validate our approach. To foster collaboration and support the robot learning community, we have open-sourced all relevant datasets and model checkpoints, available at <a class="link-external link-http" href="http://huggingface.co/ZhiChengAI" rel="external noopener nofollow">this http URL</a>.

Robotics,Artificial Intelligence
A framework for trust-related knowledge transfer in human–robot interaction

Mohammed Diab,Yiannis Demiris

DOI: https://doi.org/10.1007/s10458-024-09653-w

2024-05-30

Autonomous Agents and Multi-Agent Systems

Abstract:Trustworthy human–robot interaction (HRI) during activities of daily living (ADL) presents an interesting and challenging domain for assistive robots, particularly since methods for estimating the trust level of a human participant towards the assistive robot are still in their infancy. Trust is a multifaced concept which is affected by the interactions between the robot and the human, and depends, among other factors, on the history of the robot's functionality, the task and the environmental state. In this paper, we are concerned with the challenge of trust transfer, i.e. whether experiences from interactions on a previous collaborative task can be taken into consideration in the trust level inference for a new collaborative task. This has the potential of avoiding re-computing trust levels from scratch for every new situation. The key challenge here is to automatically evaluate the similarity between the original and the novel situation, then adapt the robot's behaviour to the novel situation using previous experience with various objects and tasks. To achieve this, we measure the semantic similarity between concepts in knowledge graphs (KGs) and adapt the robot's actions towards a specific user based on personalised interaction histories. These actions are grounded and then verified before execution using a geometric motion planner to generate feasible trajectories in novel situations. This framework has been experimentally tested in human–robot handover tasks in different kitchen scene contexts. We conclude that trust-related knowledge positively influences and improves collaboration in both performance and time aspects.

automation & control systems,computer science, artificial intelligence
Robot-To-Human Handover with Obstacle Avoidance Via Continuous Time Recurrent Neural Network

Huajin Tang,Boon Hwa Tan,Rui Yan

DOI: https://doi.org/10.1109/cec.2016.7743924

2016-01-01

Abstract:Parallel with the development of service robots, it is vital for the robots to carry out handovers autonomously. Robot-to-human handover is a coordination in time and space for a robot to deliver an object to human. A good robot-to-human handover should consider human safety and preference, natural motion planning that mimics human and adaptability to the changes of the environment. Conventional handover motion mostly rely on sampling-based algorithms that emphasizes on kinematic and dynamic analysis. This kind of motion planning could become complicated and slow in response if the handover motion is implemented in a dynamic environment where real time motion planning is required. To simplify the implementation of robot-to-human handover, a motion learning and generation framework that based on Continuous Time Recurrent Neural Network(CTRNN) is proposed. The proposed framework is equipped with the capabilities of object recognition, motion generation based on past learning experience and obstacle adaptation. As compared with conventional method, the proposed framework could be easily extended to handover motion with high dimensional configuration spaces as the motion can be generated from the learnt experience. In the proposed framework, the handover behaviour can be learnt via human-guided motion teaching which provides an intuitive and visible solution for motion planning. The proposed framework has been experimentally evaluated on a customized design robot via robot-to- human handover testing. Based on the testing, the feasibility of the proposed framework had been justified.
Toward Open Knowledge Enabling for Human-Robot Interaction

Xiaoping Chen,Jiongkun Xie,Jianmin Ji,Zhiqiang Sui

DOI: https://doi.org/10.5898/jhri.1.2.chen

2013-01-01

Journal of Human-Robot Interaction

Abstract:This paper presents an effort to enable robots to utilize open-source knowledge resources autonomously for human-robot interaction. The main challenges include how to extract knowledge in semi-structured and unstructured natural languages, how to make use of multiple types of knowledge in decision making, and how to identify the knowledge that is missing. A set of techniques for multi-mode natural language processing, integrated decision making, and open knowledge searching is proposed. The OK-KeJia robot prototype is implemented and evaluated, with special attention to two tests on 11,615 user tasks and 467 user desires. The experiments show that the overall performance improves remarkably due to the use of appropriate open knowledge.
Skill Learning Framework for Human-Robot Interaction and Manipulation Tasks

Abiodun Odesanmi,Qining Wang,Jingeng Mai

DOI: https://doi.org/10.1016/j.rcim.2022.102444

IF: 10.103

2023-01-01

Robotics and Computer-Integrated Manufacturing

Abstract:In this article, a learning framework that enables robotic arms to replicate new skills from human demonstra-tion is proposed. The learning framework makes use of online human motion data acquired using wearable devices as an interactive interface for providing the anticipated motion to the robot in an efficient and user-friendly way. This approach offers human tutors the ability to control all joints of the robotic manipulator in real-time and able to achieve complex manipulation. The robotic manipulator is controlled remotely with our low-cost wearable devices for easy calibration and continuous motion mapping. We believe that our approach might lead to improving the human-robot skill learning, adaptability, and sensitivity of the proposed human -robot interaction for flexible task execution and thereby giving room for skill transfer and repeatability without complex coding skills.
Learning Human-to-Robot Handovers from Point Clouds.

Sammy Christen,Wei Yang,Claudia Pérez-D’Arpino,Otmar Hilliges,Dieter Fox,Yu-Wei Chao

DOI: https://doi.org/10.1109/cvpr52729.2023.00931

2023-01-01

Computer Vision and Pattern Recognition

Abstract:We propose the first framework to learn control policies for vision-based human-to-robot handovers, a critical task for human-robot interaction. While research in Embodied AI has made significant progress in training robot agents in simulated environments, interacting with humans remains challenging due to the difficulties of simulating humans. Fortunately, recent research has developed realistic simulated environments for human-to-robot handovers. Leveraging this result, we introduce a method that is trained with a human-in-the-loop via a two-stage teacher-student framework that uses motion and grasp planning, reinforcement learning, and self-supervision. We show significant performance gains over baselines on a simulation benchmark, sim-to-sim transfer and sim-to-real transfer. Video and code are available at https://handover-sim2real.github.io.
Innovative multi-dimensional learning algorithm and experiment design for human-robot cooperation

Xuanming Zhang,Ye Wang,Chunxu Li,Ashraf Fahmy,Johann Sienz

DOI: https://doi.org/10.1016/j.apm.2024.01.001

IF: 5.336

2024-01-15

Applied Mathematical Modelling

Abstract:This paper proposed a learning algorithm for human-robot skill transfer based on dynamic movement primitive. Through the establishment of Transmission Control Protocol communication, the position trajectory and force characteristic of the human demonstrator while demonstrating the robot were recorded as the training data of the dynamic movement primitive model. The demonstrated skill/motion reproduction and generalization were successfully achieved through adjusting the parameters of the dynamic movement primitive model. The impedance control system investigated in this paper improved the compliance of the robot trajectory reproduction and skill generalization, and improved the robustness of robot control system in different environments. In addition, for the problem of inverse solution of redundant robots, this paper improved the dimension of constraint equations in the inverse solution of robots by training multiple dynamic movement primitive models, which guaranteed the constraints of inverse solutions of redundant robots. The proposed algorithm had been validated on a simulated robot platform using MATLAB and a ROKAE xMate robot platform, respectively.

mechanics,engineering, multidisciplinary,mathematics, interdisciplinary applications
CON: Continual Object Navigation via Data-Free Inter-Agent Knowledge Transfer in Unseen and Unfamiliar Places

Kouki Terashima,Daiki Iwata,Kanji Tanaka

2024-09-23

Abstract:This work explores the potential of brief inter-agent knowledge transfer (KT) to enhance the robotic object goal navigation (ON) in unseen and unfamiliar environments. Drawing on the analogy of human travelers acquiring local knowledge, we propose a framework in which a traveler robot (student) communicates with local robots (teachers) to obtain ON knowledge through minimal interactions. We frame this process as a data-free continual learning (CL) challenge, aiming to transfer knowledge from a black-box model (teacher) to a new model (student). In contrast to approaches like zero-shot ON using large language models (LLMs), which utilize inherently communication-friendly natural language for knowledge representation, the other two major ON approaches -- frontier-driven methods using object feature maps and learning-based ON using neural state-action maps -- present complex challenges where data-free KT remains largely uncharted. To address this gap, we propose a lightweight, plug-and-play KT module targeting non-cooperative black-box teachers in open-world settings. Using the universal assumption that every teacher robot has vision and mobility capabilities, we define state-action history as the primary knowledge base. Our formulation leads to the development of a query-based occupancy map that dynamically represents target object locations, serving as an effective and communication-friendly knowledge representation. We validate the effectiveness of our method through experiments conducted in the Habitat environment.

Robotics,Computer Vision and Pattern Recognition,Machine Learning
Enhancing Human–Robot Collaboration through a Multi-Module Interaction Framework with Sensor Fusion: Object Recognition, Verbal Communication, User of Interest Detection, Gesture and Gaze Recognition

Shuvo Kumar Paul,Mircea Nicolescu,Monica Nicolescu

DOI: https://doi.org/10.3390/s23135798

IF: 3.9

2023-06-21

Sensors

Abstract:With the increasing presence of robots in our daily lives, it is crucial to design interaction interfaces that are natural, easy to use and meaningful for robotic tasks. This is important not only to enhance the user experience but also to increase the task reliability by providing supplementary information. Motivated by this, we propose a multi-modal framework consisting of multiple independent modules. These modules take advantage of multiple sensors (e.g., image, sound, depth) and can be used separately or in combination for effective human–robot collaborative interaction. We identified and implemented four key components of an effective human robot collaborative setting, which included determining object location and pose, extracting intricate information from verbal instructions, resolving user(s) of interest (UOI), and gesture recognition and gaze estimation to facilitate the natural and intuitive interactions. The system uses a feature–detector–descriptor approach for object recognition and a homography-based technique for planar pose estimation and a deep multi-task learning model to extract intricate task parameters from verbal communication. The user of interest (UOI) is detected by estimating the facing state and active speakers. The framework also includes gesture detection and gaze estimation modules, which are combined with a verbal instruction component to form structured commands for robotic entities. Experiments were conducted to assess the performance of these interaction interfaces, and the results demonstrated the effectiveness of the approach.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Hierarchical Understanding in Robotic Manipulation: A Knowledge-Based Framework

Runqing Miao,Qingxuan Jia,Fuchun Sun,Gang Chen,Haiming Huang

DOI: https://doi.org/10.3390/act13010028

IF: 2.6

2024-01-11

Actuators

Abstract:In the quest for intelligent robots, it is essential to enable them to understand tasks beyond mere manipulation. Achieving this requires a robust parsing mode that can be used to understand human cognition and semantics. However, the existing methods for task and motion planning lack generalization and interpretability, while robotic knowledge bases primarily focus on static manipulation objects, neglecting the dynamic tasks and skills. To address these limitations, we present a knowledge-based framework for hierarchically understanding various factors and knowledge types in robotic manipulation. Using this framework as a foundation, we collect a knowledge graph dataset describing manipulation tasks from text datasets and an external knowledge base with the assistance of large language models and construct the knowledge base. The reasoning tasks of entity alignment and link prediction are accomplished using a graph embedding method. A robot in real-world environments can infer new task execution plans based on experience and knowledge, thereby achieving manipulation skill transfer.

engineering, mechanical,instruments & instrumentation
Combining Model-Based $Q$ -Learning with Structural Knowledge Transfer for Robot Skill Learning

Zhen Deng,Haojun Guan,Rui Huang,Hongzhuo Liang,Liwei Zhang,Jianwei Zhang

DOI: https://doi.org/10.1109/tcds.2017.2718938

IF: 4.546

2019-01-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:Learning skills autonomously is a particularly important ability for an autonomous robot. A promising approach is reinforcement learning (RL) where agents learn policy through interaction with its environment. One problem of RL algorithm is how to tradeoff the exploration and exploitation. Moreover, multiple tasks also make a great challenge to robot learning. In this paper, to enhance the performance of RL, a novel learning framework integrating RL with knowledge transfer is proposed. Three basic components are included: 1) probability policy reuse; 2) dynamic model learning; and 3) model-based Q-learning. In this framework, the prelearned skills are leveraged for policy reuse and dynamic learning. In model-based Q-learning, the Gaussian process regression is used to approximate the Q-value function so as to suit for robot control. The prior knowledge retrieved from knowledge transfer is integrated into the model-based Q-learning to reduce the needed learning time. Finally, a human-robot handover experiment is performed to evaluate the learning performance of this learning framework. Experiment results show that fewer exploration is needed to obtain a high expected reward, due to the prior knowledge obtained from knowledge transfer.
A Frame-Based Knowledge Model for Heterogeneous Multi-Robot System

Tao Zhang,Haruki Ueno

DOI: https://doi.org/10.1541/ieejeiss.125.846

2005-01-01

Abstract:In order to build a kind of heterogeneous multi-robot system which can perform complex activities according to human requests, by means of a software platform, this paper proposes a frame-based knowledge model for heterogeneous multi-robot system. With this model, many heterogeneous robots are integrated into a single unit. The features of robots as well as other related users are described by the proposed set of frames/slots of the model. Particularly, with frame hierarchies organized by the ISA relations of frames, typical activities of this kind of heterogeneous multi-robot system, such as human-robot interaction, various behaviors of different robots according to human requests, etc., can be defined clearly. Based on this knowledge model, the defined heterogeneous multi-robot system can be implemented by a software platform. This knowledge model is adaptable for any kinds of robots and its independence to various kinds of techniques adopted by robots provides much convenience for a software platform to integrate and flexibly utilize these techniques for building a heterogeneous multi-robot system. In this paper, an actual heterogeneous multi-robot system is modeled by the proposed method. Its activities can demonstrate the effectiveness of the proposed knowledge model.
Human-Humanoid Robots Cross-Embodiment Behavior-Skill Transfer Using Decomposed Adversarial Learning from Demonstration

Junjia Liu,Zhuo Li,Minghao Yu,Zhipeng Dong,Sylvain Calinon,Darwin Caldwell,Fei Chen

2024-12-20

Abstract:Humanoid robots are envisioned as embodied intelligent agents capable of performing a wide range of human-level loco-manipulation tasks, particularly in scenarios requiring strenuous and repetitive labor. However, learning these skills is challenging due to the high degrees of freedom of humanoid robots, and collecting sufficient training data for humanoid is a laborious process. Given the rapid introduction of new humanoid platforms, a cross-embodiment framework that allows generalizable skill transfer is becoming increasingly critical. To address this, we propose a transferable framework that reduces the data bottleneck by using a unified digital human model as a common prototype and bypassing the need for re-training on every new robot platform. The model learns behavior primitives from human demonstrations through adversarial imitation, and the complex robot structures are decomposed into functional components, each trained independently and dynamically coordinated. Task generalization is achieved through a human-object interaction graph, and skills are transferred to different robots via embodiment-specific kinematic motion retargeting and dynamic fine-tuning. Our framework is validated on five humanoid robots with diverse configurations, demonstrating stable loco-manipulation and highlighting its effectiveness in reducing data requirements and increasing the efficiency of skill transfer across platforms.

Robotics,Artificial Intelligence
Transferring Implicit Knowledge of Non-Visual Object Properties Across Heterogeneous Robot Morphologies

Gyan Tatiya,Jonathan Francis,Jivko Sinapov

DOI: https://doi.org/10.48550/arXiv.2209.06890

IF: 3.7

2022-09-14

Robotics

Abstract:Humans leverage multiple sensor modalities when interacting with objects and discovering their intrinsic properties. Using the visual modality alone is insufficient for deriving intuition behind object properties (e.g., which of two boxes is heavier), making it essential to consider non-visual modalities as well, such as the tactile and auditory. Whereas robots may leverage various modalities to obtain object property understanding via learned exploratory interactions with objects (e.g., grasping, lifting, and shaking behaviors), challenges remain: the implicit knowledge acquired by one robot via object exploration cannot be directly leveraged by another robot with different morphology, because the sensor models, observed data distributions, and interaction capabilities are different across these different robot configurations. To avoid the costly process of learning interactive object perception tasks from scratch, we propose a multi-stage projection framework for each new robot for transferring implicit knowledge of object properties across heterogeneous robot morphologies. We evaluate our approach on the object-property recognition and object-identity recognition tasks, using a dataset containing two heterogeneous robots that perform 7,600 object interactions. Results indicate that knowledge can be transferred across robots, such that a newly-deployed robot can bootstrap its recognition models without exhaustively exploring all objects. We also propose a data augmentation technique and show that this technique improves the generalization of models. We release our code and datasets, here: https://github.com/gtatiya/Implicit-Knowledge-Transfer.
A Framework for Sensorimotor Cross-Perception and Cross-Behavior Knowledge Transfer for Object Categorization

Gyan Tatiya,Ramtin Hosseini,Michael C Hughes,Jivko Sinapov

DOI: https://doi.org/10.3389/frobt.2020.522141

2020-10-09

Abstract:From an early age, humans learn to develop an intuition for the physical nature of the objects around them by using exploratory behaviors. Such exploration provides observations of how objects feel, sound, look, and move as a result of actions applied on them. Previous works in robotics have shown that robots can also use such behaviors (e.g., lifting, pressing, shaking) to infer object properties that camera input alone cannot detect. Such learned representations are specific to each individual robot and cannot currently be transferred directly to another robot with different sensors and actions. Moreover, sensor failure can cause a robot to lose a specific sensory modality which may prevent it from using perceptual models that require it as input. To address these limitations, we propose a framework for knowledge transfer across behaviors and sensory modalities such that: (1) knowledge can be transferred from one or more robots to another, and, (2) knowledge can be transferred from one or more sensory modalities to another. We propose two different models for transfer based on variational auto-encoders and encoder-decoder networks. The main hypothesis behind our approach is that if two or more robots share multi-sensory object observations of a shared set of objects, then those observations can be used to establish mappings between multiple features spaces, each corresponding to a combination of an exploratory behavior and a sensory modality. We evaluate our approach on a category recognition task using a dataset in which a robot used 9 behaviors, coupled with 4 sensory modalities, performed multiple times on 100 objects. The results indicate that sensorimotor knowledge about objects can be transferred both across behaviors and across sensory modalities, such that a new robot (or the same robot, but with a different set of sensors) can bootstrap its category recognition models without having to exhaustively explore the full set of objects.
Graph-based Hierarchical Knowledge Representation for Robot Task Transfer from Virtual to Physical World

Zhenliang Zhang,Yixin Zhu,Song-Chun Zhu

DOI: https://doi.org/10.1109/iros45743.2020.9340843

2020-01-01

Abstract:We study the hierarchical knowledge transfer problem using a cloth-folding task, wherein the agent is first given a set of human demonstrations in the virtual world using an Oculus Headset, and later transferred and validated on a physical Baxter robot. We argue that such an intricate robot task transfer across different embodiments is only realizable if an abstract and hierarchical knowledge representation is formed to facilitate the process, in contrast to prior literature of sim2real in a reinforcement learning setting. Specifically, the knowledge in both the virtual and physical worlds are measured by information entropy built on top of a graph-based representation, so that the problem of task transfer becomes the minimization of the relative entropy between the two worlds. An And-Or-Graph (AOG) is introduced to represent the knowledge, induced from the human demonstrations performed across six virtual scenarios inside the Virtual Reality (VR). During the transfer, the success of a physical Baxter robot platform across all six tasks demonstrates the efficacy of the graph-based hierarchical knowledge representation.
Knowledge Model-Based Adaptive Intelligent Control Of Robots For A Symbiotic Human-Robot System

Tao Zhang,Haruki Ueno

DOI: https://doi.org/10.1504/IJAAC.2007.013298

2007-01-01

Abstract:This paper proposes a novel knowledge model-based adaptive intelligent control of robots for a symbiotic human-robot system. In this method, a knowledge model is first defined by the frame-based knowledge representation. It contains various frames for describing different users, features of multiple robots as well as robot behaviours for human-robot interaction and performing various tasks. According to this knowledge model, the intelligent control of robots in a symbiotic human-robot system can be implemented by means of a software platform, called Software Platform for Agents and Knowledge Management (SPAK). In addition, a kind of learning function is developed and integrated into the SPAK in order that the system can autonomously learn new knowledge by human-robot interaction and generate new control strategy for robots. Hence, the symbiotic human-robot system can adapt to various situations with different human requests and realise high-autonomous intelligent control of robots. In this paper, the effectiveness of the proposed method is verified by the experiment using actual robots.

A Unified Framework for Human-Robot Knowledge Transfer.

A Human-Robot Collaboration System for Object Handover

A Robotic Manipulation Framework for Industrial Human–robot Collaboration Based on Continual Knowledge Graph Embedding

Shaping in Reinforcement Learning Via Knowledge Transferred from Human-Demonstrations

Generalized Robot Learning Framework

A framework for trust-related knowledge transfer in human–robot interaction

Robot-To-Human Handover with Obstacle Avoidance Via Continuous Time Recurrent Neural Network

Toward Open Knowledge Enabling for Human-Robot Interaction

Skill Learning Framework for Human-Robot Interaction and Manipulation Tasks

Learning Human-to-Robot Handovers from Point Clouds.

Innovative multi-dimensional learning algorithm and experiment design for human-robot cooperation

CON: Continual Object Navigation via Data-Free Inter-Agent Knowledge Transfer in Unseen and Unfamiliar Places

Enhancing Human–Robot Collaboration through a Multi-Module Interaction Framework with Sensor Fusion: Object Recognition, Verbal Communication, User of Interest Detection, Gesture and Gaze Recognition

Hierarchical Understanding in Robotic Manipulation: A Knowledge-Based Framework

Combining Model-Based $Q$ -Learning with Structural Knowledge Transfer for Robot Skill Learning

A Frame-Based Knowledge Model for Heterogeneous Multi-Robot System

Human-Humanoid Robots Cross-Embodiment Behavior-Skill Transfer Using Decomposed Adversarial Learning from Demonstration

Transferring Implicit Knowledge of Non-Visual Object Properties Across Heterogeneous Robot Morphologies

A Framework for Sensorimotor Cross-Perception and Cross-Behavior Knowledge Transfer for Object Categorization

Graph-based Hierarchical Knowledge Representation for Robot Task Transfer from Virtual to Physical World

Knowledge Model-Based Adaptive Intelligent Control Of Robots For A Symbiotic Human-Robot System