Abstract:Soft robotic grippers possess high structural compliance and adaptability, allowing them to grasp objects with unknown and irregular shapes and sizes. To enable more dexterous manipulation, soft sensors that are similar in mechanical properties to common elastomer materials are desired to be integrated into soft grippers. In this paper, we develop ionic hydrogel-based strain and tactile sensors and integrate these sensors into a three-finger soft gripper for learning-based object recognition and force-controlled grasping. Such hydrogel-based sensors have excellent conductivity, high stretchability and toughness, good ambient stability, and unique antifreezing property; they can be readily attached to a soft gripper at desired locations for strain and tactile sensing. By using a deep-learning model, the sensory soft gripper is demonstrated to be capable of grasping and recognizing objects at both room and freezing temperatures, and achieving close to 100% recognition accuracy for ten typical objects. Moreover, the capacitive tactile feedback of the gripper is utilized to develop a closed-loop force controller and realize force-controlled grasping of fragile or highly deformable objects. A new slip detection and compensation strategy is also proposed and validated for the sensory gripper for adjusting the grasping force in real time upon detecting slippage. Note to Practitioners—The multimodal sensation of a soft robotic gripper could enrich its grasping functionalities and improve its manipulation performance. This research integrates novel antifreezing ionic hydrogel-based strain and tactile sensors into a three-finger soft robotic gripper for learning-based object recognition and force-controlled grasping. Constructed from a highly stretchable, ambient-stable, and antifreezing ionic hydrogel, the strain and tactile sensors can be readily integrated at the desired locations on the soft gripper, and can reliably operate at both ambient and freezing temperatures with excellent mechanical and electrical properties. Based on the feedback of the strain and tactile sensors, a deep learning model is employed to enable high-accuracy object recognition while grasping, which can be useful for manipulation in vision-free environments. Closed-loop force control and slip compensation strategies are also demonstrated for reliably grasping fragile/deformable objects and handling slip events during the manipulation of heavy objects. The sensory soft gripper and the associated object recognition and force control methods could find practical applications in a variety of robotic manipulation tasks.

Rigid-Soft Interactive Learning for Robust Grasping

Adaptive Grasping of the Soft Prosthetic Hand Via Tactile Feedback

Active Learning-Based Grasp for Accurate Industrial Manipulation.

Design of an Optoelectronically Innervated Gripper for Rigid-Soft Interactive Grasping

Vision-Based Robotic Object Grasping—A Deep Reinforcement Learning Approach

Learning-Based Optoelectronically Innervated Tactile Finger for Rigid-Soft Interactive Grasping

Grasping Control for a Neuro-Cognitive Robot.

Learning-based robotic grasping: A review

Hybrid Robotic Grasping with a Soft Multimodal Gripper and a Deep Multistage Learning Scheme

Implementation and Optimization of Grasping Learning with Dual-modal Soft Gripper.

Learning thin deformable object manipulation with a multi-sensory integrated soft hand

Flexible and robust robotic arm design and skill learning by using recurrent neural networks

A Sensory Soft Robotic Gripper Capable of Learning-Based Object Recognition and Force-Controlled Grasping

Soft and Rigid Object Grasping With Cross-Structure Hand Using Bilateral Control-Based Imitation Learning

Learning Optimal Fin-Ray Finger Design for Soft Grasping

Design and Implementation of an Underactuated Gripper with Enhanced Shape Adaptability and Lateral Stiffness Through Semi-Active Multi-Degree-of-freedom Endoskeletons

Learning Robust Grasping Strategy Through Tactile Sensing and Adaption Skill

RISO: Combining Rigid Grippers with Soft Switchable Adhesives

Robust Grasping of a Variable Stiffness Soft Gripper in High-Speed Motion Based on Reinforcement Learning

A Reconfigurable Design for Omni-Adaptive Grasp Learning.

Design and Gesture Optimization of a Soft-Rigid Robotic Hand for Adaptive Grasping