Abstract:Haptic exploration is a key skill for both robots and humans to discriminate and handle unknown objects or to recognize familiar objects. Its active nature is evident in humans who from early on reliably acquire sophisticated sensory-motor capabilities for active exploratory touch and directed manual exploration that associates surfaces and object properties with their spatial locations. This is in stark contrast to robotics. In this field, the relative lack of good real-world interaction models-along with very restricted sensors and a scarcity of suitable training data to leverage machine learning methods-has so far rendered haptic exploration a largely underdeveloped skill. In robot vision however, deep learning approaches and an abundance of available training data have triggered huge advances. In the present work, we connect recent advances in recurrent models of visual attention with previous insights about the organisation of human haptic search behavior, exploratory procedures and haptic glances for a novel architecture that learns a generative model of haptic exploration in a simulated three-dimensional environment. This environment contains a set of rigid static objects representing a selection of one-dimensional local shape features embedded in a 3D space: an edge, a flat and a convex surface. The proposed algorithm simultaneously optimizes main perception-action loop components: feature extraction, integration of features over time, and the control strategy, while continuously acquiring data online. Inspired by the Recurrent Attention Model, we formalize the target task of haptic object identification in a reinforcement learning framework and reward the learner in the case of success only. We perform a multi-module neural network training, including a feature extractor and a recurrent neural network module aiding pose control for storing and combining sequential sensory data. The resulting haptic meta-controller for the rigid 16 × 16 tactile sensor array moving in a physics-driven simulation environment, called the Haptic Attention Model, performs a sequence of haptic glances, and outputs corresponding force measurements. The resulting method has been successfully tested with four different objects. It achieved results close to 100% while performing object contour exploration that has been optimized for its own sensor morphology.

The homunculus for proprioception: Toward learning the representation of a humanoid robot's joint space using self-organizing maps

Learning body models: from humans to humanoids

Body Models in Humans and Robots

Active exploration for body model learning through self-touch on a humanoid robot with artificial skin

Coordination of an Uncalibrated 3-D Visuo-Motor System Based on Multiple Self-Organizing Maps

Neuro-musculoskeletal modeling reveals muscle-level neural dynamics of adaptive learning in sensorimotor cortex

Sensorimotor representation learning for an "active self" in robots: A model survey

Full-Body Visual Self-Modeling of Robot Morphologies

Self Model for Embodied Intelligence: Modeling Full-Body Human Musculoskeletal System and Locomotion Control with Hierarchical Low-Dimensional Representation

Robot Body Schema Learning from Full-body Extero/Proprioception Sensors

Self-Organized Behavior Generation for Musculoskeletal Robots

Where is my forearm? Clustering of body parts from simultaneous tactile and linguistic input using sequential mapping

Learning efficient haptic shape exploration with a rigid tactile sensor array

Learning and Acting in Peripersonal Space: Moving, Reaching, and Grasping

Multiple Self-Organizing Maps for Control of a Redundant Manipulator in an Environment with Obstacles.

Sensorimotor learning for artificial body perception

An Exploratory Multi-Session Study of Learning High-Dimensional Body-Machine Interfacing for Assistive Robot Control

Brain-inspired self-organization with cellular neuromorphic computing for multimodal unsupervised learning

Machine learning-driven self-discovery of the robot body morphology

Understanding upper-limb movements via neurocomputational models of the sensorimotor system and neurorobotics: where we stand

Multiple Self-Organizing Maps for a Visuo-Motor System That Uses Multiple Cameras with Different Fields of View.