Abstract:Object recognition is an essential capability when performing various tasks. Humans naturally use either or both visual and tactile perception to extract object class and properties. Typical approaches for robots, however, require complex visual systems or multiple high-density tactile sensors which can be highly expensive. In addition, they usually require actual collection of a large dataset from real objects through direct interaction. In this paper, we propose a kinesthetic-based object recognition method that can be performed with any multi-fingered robotic hand in which the kinematics is known. The method does not require tactile sensors and is based on observing grasps of the objects. We utilize a unique and frame invariant parameterization of grasps to learn instances of object shapes. To train a classifier, training data is generated rapidly and solely in a computational process without interaction with real objects. We then propose and compare between two iterative algorithms that can integrate any trained classifier. The classifiers and algorithms are independent of any particular robot hand and, therefore, can be exerted on various ones. We show in experiments, that with few grasps, the algorithms acquire accurate classification. Furthermore, we show that the object recognition approach is scalable to objects of various sizes. Similarly, a global classifier is trained to identify general geometries (e.g., an ellipsoid or a box) rather than particular ones and demonstrated on a large set of objects. Full scale experiments and analysis are provided to show the performance of the method.

Going In Blind: Object Motion Classification using Distributed Tactile Sensing for Safe Reaching in Clutter

Dexterous Manoeuvre Through Touch in a Cluttered Scene

Learning to Detect Slip through Tactile Estimation of the Contact Force Field and its Entropy

Tactile-Driven Non-Prehensile Object Manipulation via Extrinsic Contact Mode Control

Kinesthetic-based In-Hand Object Recognition with an Underactuated Robotic Hand

Contact-Aware Non-prehensile Robotic Manipulation for Object Retrieval in Cluttered Environments

Under Pressure: Learning to Detect Slip with Barometric Tactile Sensors

Contact-Aware Non-Prehensile Manipulation for Object Retrieval in Cluttered Environments

A model-free approach to fingertip slip and disturbance detection for grasp stability inference

Realtime State Estimation with Tactile and Visual Sensing. Application to Planar Manipulation

Inter-finger Small Object Manipulation With DenseTact Optical Tactile Sensor

Placing by Touching: An empirical study on the importance of tactile sensing for precise object placing

Simple Kinesthetic Haptics for Object Recognition

Methods for safe human-robot-interaction using capacitive tactile proximity sensors

Learning to Detect Slip with Barometric Tactile Sensors and a Temporal Convolutional Neural Network

Leveraging distributed contact force measurements for slip detection: a physics-based approach enabled by a data-driven tactile sensor

Enabling Robot Manipulation of Soft and Rigid Objects with Vision-based Tactile Sensors

Using tactile sensation for learning contact knowledge: Discriminate collision from physical interaction

Multimodal Contact Detection using Auditory and Force Features for Reliable Object Placing in Household Environments

Embedded Object Detection and Mapping in Soft Materials Using Optical Tactile Sensing

Sliding Touch-based Exploration for Modeling Unknown Object Shape with Multi-fingered Hands