Method for removal of non-magnetic foreign bodies.

J. Worst

Abstract:

What problem does this paper attempt to address?

Hierarchical Affordance Discovery using Intrinsic Motivation

Alexandre Manoury,Sao Mai Nguyen,Cédric Buche

DOI: https://doi.org/10.1145/3349537.3351898

2020-09-23

Abstract:To be capable of lifelong learning in a real-life environment, robots have to tackle multiple challenges. Being able to relate physical properties they may observe in their environment to possible interactions they may have is one of them. This skill, named affordance learning, is strongly related to embodiment and is mastered through each person's development: each individual learns affordances differently through their own interactions with their surroundings. Current methods for affordance learning usually use either fixed actions to learn these affordances or focus on static setups involving a robotic arm to be operated. In this article, we propose an algorithm using intrinsic motivation to guide the learning of affordances for a mobile robot. This algorithm is capable to autonomously discover, learn and adapt interrelated affordances without pre-programmed actions. Once learned, these affordances may be used by the algorithm to plan sequences of actions in order to perform tasks of various difficulties. We then present one experiment and analyse our system before comparing it with other approaches from reinforcement learning and affordance learning.

Artificial Intelligence
Object-centric proto-symbolic behavioural reasoning from pixels

Ruben van Bergen,Justus Hübotter,Pablo Lanillos

2024-11-26

Abstract:Autonomous intelligent agents must bridge computational challenges at disparate levels of abstraction, from the low-level spaces of sensory input and motor commands to the high-level domain of abstract reasoning and planning. A key question in designing such agents is how best to instantiate the representational space that will interface between these two levels -- ideally without requiring supervision in the form of expensive data annotations. These objectives can be efficiently achieved by representing the world in terms of objects (grounded in perception and action). In this work, we present a novel, brain-inspired, deep-learning architecture that learns from pixels to interpret, control, and reason about its environment, using object-centric representations. We show the utility of our approach through tasks in synthetic environments that require a combination of (high-level) logical reasoning and (low-level) continuous control. Results show that the agent can learn emergent conditional behavioural reasoning, such as $(A \to B) \land (\neg A \to C)$, as well as logical composition $(A \to B) \land (A \to C) \vdash A \to (B \land C)$ and XOR operations, and successfully controls its environment to satisfy objectives deduced from these logical rules. The agent can adapt online to unexpected changes in its environment and is robust to mild violations of its world model, thanks to dynamic internal desired goal generation. While the present results are limited to synthetic settings (2D and 3D activated versions of dSprites), which fall short of real-world levels of complexity, the proposed architecture shows how to manipulate grounded object representations, as a key inductive bias for unsupervised learning, to enable behavioral reasoning.

Artificial Intelligence,Computer Vision and Pattern Recognition,Neural and Evolutionary Computing
Robot Cognitive Learning by Considering Physical Properties

Fuchun Sun,Wenbing Huang,Yu Luo,Tianying Ji,Huaping Liu,He Liu,Jianwei Zhang

DOI: https://doi.org/10.1016/j.eng.2024.10.013

IF: 12.834

2024-01-01

Engineering

Abstract:Humans achieve cognitive development through continuous interaction with their environment, enhancing both perception and behavior. However, current robots lack the capacity for human-like action and evolution, posing a bottleneck to improving robotic intelligence. Existing research predominantly models robots as one-way, static mappings from observations to actions, neglecting the dynamic processes of perception and behavior. This paper introduces a novel approach to robot cognitive learning by considering physical properties. We propose a theoretical framework wherein a robot is conceptualized as a three-body physical system comprising a perception-body (P-body), a cognition-body (C-body), and a behavior-body (B-body). Each body engages in physical dynamics and operates within a closed-loop interaction. Significantly, three crucial interactions connect these bodies. The C-body relies on the P-body’s extracted states and reciprocally offers long-term rewards, optimizing the P-body’s perception policy. In addition, the C-body directs the B-body’s actions through sub-goals, and subsequent P-body-derived states facilitate the C-body’s cognition dynamics learning. At last, the B-body would follow the sub-goal generated by the C-body and perform actions conditioned on the perceptive state from the P-body, which leads to the next interactive step. These interactions foster the joint evolution of each body, culminating in optimal design. To validate our approach, we employ a navigation task using a four-legged robot, D’Kitty, equipped with a movable global camera. Navigational prowess demands intricate coordination of sensing, planning, and D’Kitty’s motion. Leveraging our framework yields superior task performance compared with conventional methodologies. In conclusion, this paper establishes a paradigm shift in robot cognitive learning by integrating physical interactions across the P-body, C-body, and B-body, while considering physical properties. Our framework’s successful application to a navigation task underscores its efficacy in enhancing robotic intelligence.
Interactive Robot Learning of Gestures, Language and Affordances

Giovanni Saponaro,Lorenzo Jamone,Alexandre Bernardino,Giampiero Salvi

DOI: https://doi.org/10.48550/arXiv.1711.09055

IF: 3.7

2017-11-24

Robotics

Abstract:A growing field in robotics and Artificial Intelligence (AI) research is human-robot collaboration, whose target is to enable effective teamwork between humans and robots. However, in many situations human teams are still superior to human-robot teams, primarily because human teams can easily agree on a common goal with language, and the individual members observe each other effectively, leveraging their shared motor repertoire and sensorimotor resources. This paper shows that for cognitive robots it is possible, and indeed fruitful, to combine knowledge acquired from interacting with elements of the environment (affordance exploration) with the probabilistic observation of another agent's actions. We propose a model that unites (i) learning robot affordances and word descriptions with (ii) statistical recognition of human gestures with vision sensors. We discuss theoretical motivations, possible implementations, and we show initial results which highlight that, after having acquired knowledge of its surrounding environment, a humanoid robot can generalize this knowledge to the case when it observes another agent (human partner) performing the same motor actions previously executed during training.
What Can This Robot Do? Learning from Appearance and Experiments

Ashwin Khadke,Manuela Veloso

DOI: https://doi.org/10.48550/arXiv.1712.05497

2018-08-02

Abstract:When presented with an unknown robot (subject) how can an autonomous agent (learner) figure out what this new robot can do? The subject's appearance can provide cues to its physical as well as cognitive capabilities. Seeing a humanoid can make one wonder if it can kick balls, climb stairs or recognize faces. What if the learner can request the subject to perform these tasks? We present an approach to make the learner build a model of the subject at a task based on the latter's appearance and refine it by experimentation. Apart from the subject's inherent capabilities, certain extrinsic factors may affect its performance at a task. Based on the subject's appearance and prior knowledge about the task a learner can identify a set of potential factors, a subset of which we assume are controllable. Our approach picks values of controllable factors to generate the most informative experiments to test the subject at. Additionally, we present a metric to determine if a factor should be incorporated in the model. We present results of our approach on modeling a humanoid robot at the task of kicking a ball. Firstly, we show that actively picking values for controllable factors, even in noisy experiments, leads to faster learning of the subject's model for the task. Secondly, starting from a minimal set of factors our metric identifies the set of relevant factors to incorporate in the model. Lastly, we show that the refined model better represents the subject's performance at the task.

Artificial Intelligence,Robotics
Towards Modeling and Influencing the Dynamics of Human Learning

Ran Tian,Masayoshi Tomizuka,Anca Dragan,Andrea Bajcsy

DOI: https://doi.org/10.48550/arXiv.2301.00901

2023-01-03

Abstract:Humans have internal models of robots (like their physical capabilities), the world (like what will happen next), and their tasks (like a preferred goal). However, human internal models are not always perfect: for example, it is easy to underestimate a robot's inertia. Nevertheless, these models change and improve over time as humans gather more experience. Interestingly, robot actions influence what this experience is, and therefore influence how people's internal models change. In this work we take a step towards enabling robots to understand the influence they have, leverage it to better assist people, and help human models more quickly align with reality. Our key idea is to model the human's learning as a nonlinear dynamical system which evolves the human's internal model given new observations. We formulate a novel optimization problem to infer the human's learning dynamics from demonstrations that naturally exhibit human learning. We then formalize how robots can influence human learning by embedding the human's learning dynamics model into the robot planning problem. Although our formulations provide concrete problem statements, they are intractable to solve in full generality. We contribute an approximation that sacrifices the complexity of the human internal models we can represent, but enables robots to learn the nonlinear dynamics of these internal models. We evaluate our inference and planning methods in a suite of simulated environments and an in-person user study, where a 7DOF robotic arm teaches participants to be better teleoperators. While influencing human learning remains an open problem, our results demonstrate that this influence is possible and can be helpful in real human-robot interaction.

Robotics,Artificial Intelligence
Causal-Based Approaches to Explain and Learn from Self-Extension—A Review

Rebeca Marfil,Pablo Bustos,Antonio Bandera

DOI: https://doi.org/10.3390/electronics13071169

IF: 2.9

2024-03-22

Electronics

Abstract:The last decades have seen a revolution in autonomous robotics. Deep learning approaches and their hardware implementations have made it possible to endow robots with extraordinary perceptual capabilities. In addition, they can benefit from advances in Automated Planning, allowing them to autonomously solve complex tasks. However, on many occasions, the robot still acts without internalising and understanding the reasons behind a perception or an action, beyond an immediate response to a current state of the context. This gap results in limitations that affect its performance, reliability, and trustworthiness. Deep learning alone cannot bridge this gap because the reasons behind behaviour, when it emanates from a model in which the world is a black-box, are not accessible. What is really needed is an underlying architecture based on deeper reasoning. Among other issues, this architecture should enable the robot to generate explanations, allowing people to know why the robot is performing, or has performed, a certain action, or the reasons that may have caused a certain plan failure or perceptual anomaly. Furthermore, when these explanations arise from a cognitive process and are shared, and thus validated, with people, the robot should be able to incorporate these explanations into its knowledge base, and thus use this understanding to improve future behaviour. Our article looks at recent advances in the development of self-aware, self-evolving robots. These robots are designed to provide the necessary explanations to their human counterparts, thereby enhancing their functional capabilities in the quest to gain their trust.

engineering, electrical & electronic,computer science, information systems,physics, applied
NeuroCERIL: Robotic Imitation Learning via Hierarchical Cause-Effect Reasoning in Programmable Attractor Neural Networks

Gregory P. Davis,Garrett E. Katz,Rodolphe J. Gentili,James A. Reggia

DOI: https://doi.org/10.48550/arXiv.2211.06462

2022-11-12

Abstract:Imitation learning allows social robots to learn new skills from human teachers without substantial manual programming, but it is difficult for robotic imitation learning systems to generalize demonstrated skills as well as human learners do. Contemporary neurocomputational approaches to imitation learning achieve limited generalization at the cost of data-intensive training, and often produce opaque models that are difficult to understand and debug. In this study, we explore the viability of developing purely-neural controllers for social robots that learn to imitate by reasoning about the underlying intentions of demonstrated behaviors. We present NeuroCERIL, a brain-inspired neurocognitive architecture that uses a novel hypothetico-deductive reasoning procedure to produce generalizable and human-readable explanations for demonstrated behavior. This approach combines bottom-up abductive inference with top-down predictive verification, and captures important aspects of human causal reasoning that are relevant to a broad range of cognitive domains. Our empirical results demonstrate that NeuroCERIL can learn various procedural skills in a simulated robotic imitation learning domain. We also show that its causal reasoning procedure is computationally efficient, and that its memory use is dominated by highly transient short-term memories, much like human working memory. We conclude that NeuroCERIL is a viable neural model of human-like imitation learning that can improve human-robot collaboration and contribute to investigations of the neurocomputational basis of human cognition.

Robotics,Artificial Intelligence
A psychology based approach for longitudinal development in cognitive robotics

J. Law,P. Shaw,K. Earland,M. Sheldon,M. Lee

DOI: https://doi.org/10.3389/fnbot.2014.00001

IF: 3.493

2014-01-01

Frontiers in Neurorobotics

Abstract:A major challenge in robotics is the ability to learn, from novel experiences, new behavior that is useful for achieving new goals and skills. Autonomous systems must be able to learn solely through the environment, thus ruling out a priori task knowledge, tuning, extensive training, or other forms of pre-programming. Learning must also be cumulative and incremental, as complex skills are built on top of primitive skills. Additionally, it must be driven by intrinsic motivation because formative experience is gained through autonomous activity, even in the absence of extrinsic goals or tasks. This paper presents an approach to these issues through robotic implementations inspired by the learning behavior of human infants. We describe an approach to developmental learning and present results from a demonstration of longitudinal development on an iCub humanoid robot. The results cover the rapid emergence of staged behavior, the role of constraints in development, the effect of bootstrapping between stages, and the use of a schema memory of experiential fragments in learning new skills. The context is a longitudinal experiment in which the robot advanced from uncontrolled motor babbling to skilled hand/eye integrated reaching and basic manipulation of objects. This approach offers promise for further fast and effective sensory-motor learning techniques for robotic learning.

robotics,computer science, artificial intelligence,neurosciences
What Can I Do Here? Learning New Skills by Imagining Visual Affordances

Alexander Khazatsky,Ashvin Nair,Daniel Jing,Sergey Levine

DOI: https://doi.org/10.48550/arXiv.2106.00671

2021-06-13

Abstract:A generalist robot equipped with learned skills must be able to perform many tasks in many different environments. However, zero-shot generalization to new settings is not always possible. When the robot encounters a new environment or object, it may need to finetune some of its previously learned skills to accommodate this change. But crucially, previously learned behaviors and models should still be suitable to accelerate this relearning. In this paper, we aim to study how generative models of possible outcomes can allow a robot to learn visual representations of affordances, so that the robot can sample potentially possible outcomes in new situations, and then further train its policy to achieve those outcomes. In effect, prior data is used to learn what kinds of outcomes may be possible, such that when the robot encounters an unfamiliar setting, it can sample potential outcomes from its model, attempt to reach them, and thereby update both its skills and its outcome model. This approach, visuomotor affordance learning (VAL), can be used to train goal-conditioned policies that operate on raw image inputs, and can rapidly learn to manipulate new objects via our proposed affordance-directed exploration scheme. We show that VAL can utilize prior data to solve real-world tasks such drawer opening, grasping, and placing objects in new scenes with only five minutes of online experience in the new scene.

Robotics,Computer Vision and Pattern Recognition,Machine Learning
Social Cognition for Human-Robot Symbiosis—Challenges and Building Blocks

Giulio Sandini,Vishwanathan Mohan,Alessandra Sciutti,Pietro Morasso

DOI: https://doi.org/10.3389/fnbot.2018.00034

IF: 3.493

2018-07-11

Frontiers in Neurorobotics

Abstract:The next generation of robot companions or robot working partners will need to satisfy social requirements somehow similar to the famous laws of robotics envisaged by Isaac Asimov time ago (Asimov, 1942). The necessary technology has almost reached the required level, including sensors and actuators, but the cognitive organization is still in its infancy and is only partially supported by the current understanding of brain cognitive processes. The brain of symbiotic robots will certainly not be a "positronic" replica of the human brain: probably, the greatest part of it will be a set of interacting computational processes running in the cloud. In this article, we review the challenges that must be met in the design of a set of interacting computational processes as building blocks of a cognitive architecture that may give symbiotic capabilities to collaborative robots of the next decades: (1) an animated body-schema; (2) an imitation machinery; (3) a motor intentions machinery; (4) a set of physical interaction mechanisms; and (5) a shared memory system for incremental symbiotic development. We would like to stress that our approach is totally un-hierarchical: the five building blocks of the shared cognitive architecture are fully bi-directionally connected. For example, imitation and intentional processes require the "services" of the animated body schema which, on the other hand, can run its simulations if appropriately prompted by imitation and/or intention, with or without physical interaction. Successful experiences can leave a trace in the shared memory system and chunks of memory fragment may compete to participate to novel cooperative actions. And so on and so forth. At the heart of the system is lifelong training and learning but, different from the conventional learning paradigms in neural networks, where learning is somehow passively imposed by an external agent, in symbiotic robots there is an element of free choice of what is worth learning, driven by the interaction between the robot and the human partner. The proposed set of building blocks is certainly a rough approximation of what is needed by symbiotic robots but we believe it is a useful starting point for building a computational framework.

robotics,computer science, artificial intelligence,neurosciences
Affordance-Centric Policy Learning: Sample Efficient and Generalisable Robot Policy Learning using Affordance-Centric Task Frames

Krishan Rana,Jad Abou-Chakra,Sourav Garg,Robert Lee,Ian Reid,Niko Suenderhauf

2024-10-16

Abstract:Affordances are central to robotic manipulation, where most tasks can be simplified to interactions with task-specific regions on objects. By focusing on these key regions, we can abstract away task-irrelevant information, simplifying the learning process, and enhancing generalisation. In this paper, we propose an affordance-centric policy-learning approach that centres and appropriately \textit{orients} a \textit{task frame} on these affordance regions allowing us to achieve both \textbf{intra-category invariance} -- where policies can generalise across different instances within the same object category -- and \textbf{spatial invariance} -- which enables consistent performance regardless of object placement in the environment. We propose a method to leverage existing generalist large vision models to extract and track these affordance frames, and demonstrate that our approach can learn manipulation tasks using behaviour cloning from as little as 10 demonstrations, with equivalent generalisation to an image-based policy trained on 305 demonstrations. We provide video demonstrations on our project site: <a class="link-external link-https" href="https://affordance-policy.github.io" rel="external noopener nofollow">this https URL</a>.

Robotics,Artificial Intelligence
Learning body models: from humans to humanoids

Matej Hoffmann

DOI: https://doi.org/10.48550/arXiv.2211.03049

IF: 3.7

2022-11-06

Robotics

Abstract:Humans and animals excel in combining information from multiple sensory modalities, controlling their complex bodies, adapting to growth, failures, or using tools. These capabilities are also highly desirable in robots. They are displayed by machines to some extent. Yet, the artificial creatures are lagging behind. The key foundation is an internal representation of the body that the agent - human, animal, or robot - has developed. The mechanisms of operation of body models in the brain are largely unknown and even less is known about how they are constructed from experience after birth. In collaboration with developmental psychologists, we conducted targeted experiments to understand how infants acquire first "sensorimotor body knowledge". These experiments inform our work in which we construct embodied computational models on humanoid robots that address the mechanisms behind learning, adaptation, and operation of multimodal body representations. At the same time, we assess which of the features of the "body in the brain" should be transferred to robots to give rise to more adaptive and resilient, self-calibrating machines. We extend traditional robot kinematic calibration focusing on self-contained approaches where no external metrology is needed: self-contact and self-observation. Problem formulation allowing to combine several ways of closing the kinematic chain simultaneously is presented, along with a calibration toolbox and experimental validation on several robot platforms. Finally, next to models of the body itself, we study peripersonal space - the space immediately surrounding the body. Again, embodied computational models are developed and subsequently, the possibility of turning these biologically inspired representations into safe human-robot collaboration is studied.
Cognitive Architecture for Mutual Modelling

Alexis Jacq,Wafa Johal,Pierre Dillenbourg,Ana Paiva

DOI: https://doi.org/10.48550/arXiv.1602.06703

IF: 3.7

2016-02-22

Robotics

Abstract:In social robotics, robots needs to be able to be understood by humans. Especially in collaborative tasks where they have to share mutual knowledge. For instance, in an educative scenario, learners share their knowledge and they must adapt their behaviour in order to make sure they are understood by others. Learners display behaviours in order to show their understanding and teachers adapt in order to make sure that the learners' knowledge is the required one. This ability requires a model of their own mental states perceived by others: \textit{"has the human understood that I(robot) need this object for the task or should I explain it once again ?"} In this paper, we discuss the importance of a cognitive architecture enabling second-order Mutual Modelling for Human-Robot Interaction in educative contexts.
Building Machines That Learn and Think Like People

Brenden M. Lake,Tomer D. Ullman,Joshua B. Tenenbaum,Samuel J. Gershman

DOI: https://doi.org/10.48550/arXiv.1604.00289

2016-11-03

Abstract:Recent progress in artificial intelligence (AI) has renewed interest in building systems that learn and think like people. Many advances have come from using deep neural networks trained end-to-end in tasks such as object recognition, video games, and board games, achieving performance that equals or even beats humans in some respects. Despite their biological inspiration and performance achievements, these systems differ from human intelligence in crucial ways. We review progress in cognitive science suggesting that truly human-like learning and thinking machines will have to reach beyond current engineering trends in both what they learn, and how they learn it. Specifically, we argue that these machines should (a) build causal models of the world that support explanation and understanding, rather than merely solving pattern recognition problems; (b) ground learning in intuitive theories of physics and psychology, to support and enrich the knowledge that is learned; and (c) harness compositionality and learning-to-learn to rapidly acquire and generalize knowledge to new tasks and situations. We suggest concrete challenges and promising routes towards these goals that can combine the strengths of recent neural network advances with more structured cognitive models.

Artificial Intelligence,Computer Vision and Pattern Recognition,Machine Learning,Neural and Evolutionary Computing
DAC-h3: A Proactive Robot Cognitive Architecture to Acquire and Express Knowledge About the World and the Self

Clément Moulin-Frier,Tobias Fischer,Maxime Petit,Grégoire Pointeau,Jordi-Ysard Puigbo,Ugo Pattacini,Sock Ching Low,Daniel Camilleri,Phuong Nguyen,Matej Hoffmann,Hyung Jin Chang,Martina Zambelli,Anne-Laure Mealier,Andreas Damianou,Giorgio Metta,Tony J. Prescott,Yiannis Demiris,Peter Ford Dominey,Paul F. M. J. Verschure

DOI: https://doi.org/10.1109/TCDS.2017.2754143

2017-09-19

Abstract:This paper introduces a cognitive architecture for a humanoid robot to engage in a proactive, mixed-initiative exploration and manipulation of its environment, where the initiative can originate from both the human and the robot. The framework, based on a biologically-grounded theory of the brain and mind, integrates a reactive interaction engine, a number of state-of-the-art perceptual and motor learning algorithms, as well as planning abilities and an autobiographical memory. The architecture as a whole drives the robot behavior to solve the symbol grounding problem, acquire language capabilities, execute goal-oriented behavior, and express a verbal narrative of its own experience in the world. We validate our approach in human-robot interaction experiments with the iCub humanoid robot, showing that the proposed cognitive architecture can be applied in real time within a realistic scenario and that it can be used with naive users.

Artificial Intelligence,Robotics
An Experimental Autonomous Articulated Robot that can Learn

Ahmed S. Mohamed,William W. Armstrong

DOI: https://doi.org/10.1007/978-3-662-39962-0_35

1989-01-01

Abstract:An important feature of any intelligent autonomous robot is the capability of acquiring knowledge about its environment and learning from its previous experiences. Long response times for reasoning and decision-making have to be avoided. Consequently the process of knowledge acquisition as well as the type of internal knowledge representation have to be designed very carefully with respect to processing time and performance requirements. This paper proposes a multi-legged autonomous articulated robot that maintains nested hierarchical production rules capable of embodying learned knowledge and enabling control using a knowledge-based control system. The proposed robot merges methodologies taken from computer numerical control (mathematical methods in robotics, and biomechanics) with methodologies taken from motor learning (knowledge-based processing as studied in artificial intelligence and behavioural psychology). Both methodologies act together to provide a control system mat functions somewhat like human procedures for perception, planning and motion execution. The robot’s actions and most internal operations of its acquisition, planning and decision making arc monitored through a color graphics simulation.
Skull Base Cerebrospinal Fluid Leakage Control with a Fibrin-Based Composite Tissue Adhesive

J. Rock,D. H. Sierra,Frederico Castro-Moure,Feng Jiang

DOI: https://doi.org/10.1055/s-2008-1058636

1996-07-01

Skull Base

Abstract:Cerebrospinal fluid (CSF) leaks can be responsible for significant patient morbidity and mortality. While the majority of leaks induced after head trauma will seal without intervention, spontaneous or surgically-induced leaks often require operative repair. Many modifications on standard surgical technique are available for repair of CSF fistulae, but none assures adequate closure. We have studied the efficacy of a novel fibrin-based composite tissue adhesive (CTA) for closure of experimentally-induced CSF leaks in rats. Fistulae were created in two groups of animals. Two weeks after creation of the leaks, the animals were sacrificed and analyzed for persistence of leak. A 58% leakage rate was noted in the control group (n = 12), and no leaks were noted in the experimental group closed after application of CTA to the surgical defect followed by skin closure (n = 11). Comparing the control group to the experimental group, results were statistically significant (p = 0.015). These data suggest that CTA may be effective as an adjunct for the closure of CSF fistulae.
Unified Learning from Demonstrations, Corrections, and Preferences during Physical Human-Robot Interaction

Shaunak A. Mehta,Dylan P. Losey

2024-01-10

Abstract:Humans can leverage physical interaction to teach robot arms. This physical interaction takes multiple forms depending on the task, the user, and what the robot has learned so far. State-of-the-art approaches focus on learning from a single modality, or combine multiple interaction types by assuming that the robot has prior information about the human's intended task. By contrast, in this paper we introduce an algorithmic formalism that unites learning from demonstrations, corrections, and preferences. Our approach makes no assumptions about the tasks the human wants to teach the robot; instead, we learn a reward model from scratch by comparing the human's inputs to nearby alternatives. We first derive a loss function that trains an ensemble of reward models to match the human's demonstrations, corrections, and preferences. The type and order of feedback is up to the human teacher: we enable the robot to collect this feedback passively or actively. We then apply constrained optimization to convert our learned reward into a desired robot trajectory. Through simulations and a user study we demonstrate that our proposed approach more accurately learns manipulation tasks from physical human interaction than existing baselines, particularly when the robot is faced with new or unexpected objectives. Videos of our user study are available at: <a class="link-external link-https" href="https://youtu.be/FSUJsTYvEKU" rel="external noopener nofollow">this https URL</a>

Robotics
Learning Skills from Demonstrations: A Trend from Motion Primitives to Experience Abstraction

Mehrdad Tavassoli,Sunny Katyara,Maria Pozzi,Nikhil Deshpande,Darwin G. Caldwell,Domenico Prattichizzo

DOI: https://doi.org/10.48550/arXiv.2210.08060

2022-10-15

Abstract:The uses of robots are changing from static environments in factories to encompass novel concepts such as Human-Robot Collaboration in unstructured settings. Pre-programming all the functionalities for robots becomes impractical, and hence, robots need to learn how to react to new events autonomously, just like humans. However, humans, unlike machines, are naturally skilled in responding to unexpected circumstances based on either experiences or observations. Hence, embedding such anthropoid behaviours into robots entails the development of neuro-cognitive models that emulate motor skills under a robot learning paradigm. Effective encoding of these skills is bound to the proper choice of tools and techniques. This paper studies different motion and behaviour learning methods ranging from Movement Primitives (MP) to Experience Abstraction (EA), applied to different robotic tasks. These methods are scrutinized and then experimentally benchmarked by reconstructing a standard pick-n-place task. Apart from providing a standard guideline for the selection of strategies and algorithms, this paper aims to draw a perspectives on their possible extensions and improvements

Robotics,Systems and Control

Method for removal of non-magnetic foreign bodies.

Hierarchical Affordance Discovery using Intrinsic Motivation

Object-centric proto-symbolic behavioural reasoning from pixels

Robot Cognitive Learning by Considering Physical Properties

Interactive Robot Learning of Gestures, Language and Affordances

What Can This Robot Do? Learning from Appearance and Experiments

Towards Modeling and Influencing the Dynamics of Human Learning

Causal-Based Approaches to Explain and Learn from Self-Extension—A Review

NeuroCERIL: Robotic Imitation Learning via Hierarchical Cause-Effect Reasoning in Programmable Attractor Neural Networks

A psychology based approach for longitudinal development in cognitive robotics

What Can I Do Here? Learning New Skills by Imagining Visual Affordances

Social Cognition for Human-Robot Symbiosis—Challenges and Building Blocks

Affordance-Centric Policy Learning: Sample Efficient and Generalisable Robot Policy Learning using Affordance-Centric Task Frames

Learning body models: from humans to humanoids

Cognitive Architecture for Mutual Modelling

Building Machines That Learn and Think Like People

DAC-h3: A Proactive Robot Cognitive Architecture to Acquire and Express Knowledge About the World and the Self

An Experimental Autonomous Articulated Robot that can Learn

Skull Base Cerebrospinal Fluid Leakage Control with a Fibrin-Based Composite Tissue Adhesive

Unified Learning from Demonstrations, Corrections, and Preferences during Physical Human-Robot Interaction

Learning Skills from Demonstrations: A Trend from Motion Primitives to Experience Abstraction