Abstract:The International Journal of Robotics Research, Ahead of Print. This study proposes a modularized soft robotic arm with integrated sensing of human touches for physical human–robot interactions. The proposed robotic arm is constructed by connecting multiple soft manipulator modules, each of which consists of three bellow-type soft actuators, pneumatic valves, and an on-board sensing and control circuit. By employing stereolithography three-dimensional (3D) printing technique, the bellow actuator is capable of incorporating embedded organogel channels in the thin wall of its body that are used for detecting human touches. The organogel thus serves as a soft interface for recognizing the intentions of the human operators, enabling the robot to interact with them while generating desired motions of the manipulator. In addition to the touch sensors, each manipulator module has compact, soft string sensors for detecting the displacements of the bellow actuators. When combined with an inertial measurement unit (IMU), the manipulator module has a capability of estimating its own pose or orientation internally. We also propose a localization method that allows us to estimate the location of the manipulator module and to acquire the 3D information of the target point in an uncontrolled environment. The proposed method uses only a single depth camera combined with a deep learning model and is thus much simpler than those of conventional motion capture systems that usually require multiple cameras in a controlled environment. Using the feedback information from the internal sensors and camera, we implemented closed-loop control algorithms to carry out tasks of reaching and grasping objects. The manipulator module shows structural robustness and the performance reliability over 5,000 cycles of repeated actuation. It shows a steady-state error and a standard deviation of 0.8 mm and 0.3 mm, respectively, using the proposed localization method and the string sensor data. We demonstrate an application example of human–robot interaction that uses human touches as triggers to pick up and manipulate target objects. The proposed soft robotic arm can be easily installed in a variety of human workspaces, since it has the ability to interact safely with humans, eliminating the need for strict control of the environments for visual perception. We believe that the proposed system has the potential to integrate soft robots into our daily lives.

A Suspended, 3D Morphing Sensory System for Robots to Feel and Protect (Adv. Mater. 29/2024)

A Suspended, Three‐dimensional Morphing Sensory System for Robots to Feel and Protect

Beyond End-Effector: Utilizing High-Resolution Tactile Signals for Physical Human–Robot Interaction

Fluid-Driven Soft CoboSkin for Safer Human-Robot Collaboration: Fabrication and Adaptation.

Design and Implementation of Robot Skin Using Highly Sensitive Sponge Sensor

Progress on Flexible Tactile Sensors in Robotic Applications on Objects Properties Recognition, Manipulation and Human-Machine Interactions

Multifunctional Tactile Feedbacks Towards Compliant Robot Manipulations via 3D-Shaped Electronic Skin

Highly Stretchable and Sensitive Strain Sensor Based on Porous Materials and Rhombic‐Mesh Structures for Robot Teleoperation (adv. Sensor Res. 10/2023)

Optical Nanofiber Skins for Multifunctional Humanoid Tactility

Multifunctional Electronic Skins Enable Robots to Safely and Dexterously Interact with Human

AI-Based Soft Module for Safe Human–Robot Interaction towards 4D Printing

Self-Adaptive Perception of Object's Deformability with Multiple Deformation Attributes Utilizing Biomimetic Mechanoreceptors

Triboelectric and Iontronic Dual-Responsive Bioinspired Ionic Skin for Human–like Dexterous Robotic Manipulation

Soft Robot Skin With Conformal Adaptability for On-Body Tactile Perception of Collaborative Robots

An Artificial Peripheral Neural System Based on Highly Stretchable and Integrated Multifunctional Sensors

Soft modularized robotic arm for safe human–robot interaction based on visual and proprioceptive feedback

A Multifunctional Tactile Sensory System for Robotic Intelligent Identification and Manipulation Perception

A warm hug from a robot: A dual-mode e-skin with programming compliance

A Multi‐Module Sensing and Bi‐Directional HMI Integrating Interaction, Recognition, and Feedback for Intelligent Robots

Soft Robotic Manipulation System Capable of Stiffness Variation and Dexterous Operation for Safe Human–Machine Interactions

Bioinspired Co‐Design of Tactile Sensor and Deep Learning Algorithm for Human–Robot Interaction