Abstract:The International Journal of Robotics Research, Ahead of Print. This study proposes a modularized soft robotic arm with integrated sensing of human touches for physical human–robot interactions. The proposed robotic arm is constructed by connecting multiple soft manipulator modules, each of which consists of three bellow-type soft actuators, pneumatic valves, and an on-board sensing and control circuit. By employing stereolithography three-dimensional (3D) printing technique, the bellow actuator is capable of incorporating embedded organogel channels in the thin wall of its body that are used for detecting human touches. The organogel thus serves as a soft interface for recognizing the intentions of the human operators, enabling the robot to interact with them while generating desired motions of the manipulator. In addition to the touch sensors, each manipulator module has compact, soft string sensors for detecting the displacements of the bellow actuators. When combined with an inertial measurement unit (IMU), the manipulator module has a capability of estimating its own pose or orientation internally. We also propose a localization method that allows us to estimate the location of the manipulator module and to acquire the 3D information of the target point in an uncontrolled environment. The proposed method uses only a single depth camera combined with a deep learning model and is thus much simpler than those of conventional motion capture systems that usually require multiple cameras in a controlled environment. Using the feedback information from the internal sensors and camera, we implemented closed-loop control algorithms to carry out tasks of reaching and grasping objects. The manipulator module shows structural robustness and the performance reliability over 5,000 cycles of repeated actuation. It shows a steady-state error and a standard deviation of 0.8 mm and 0.3 mm, respectively, using the proposed localization method and the string sensor data. We demonstrate an application example of human–robot interaction that uses human touches as triggers to pick up and manipulate target objects. The proposed soft robotic arm can be easily installed in a variety of human workspaces, since it has the ability to interact safely with humans, eliminating the need for strict control of the environments for visual perception. We believe that the proposed system has the potential to integrate soft robots into our daily lives.

Anthropomorphic Muscular–Skeletal Robotic Upper Limb for Understanding Embodied Intelligence

Punyo-1: Soft tactile-sensing upper-body robot for large object manipulation and physical human interaction

Soft modularized robotic arm for safe human–robot interaction based on visual and proprioceptive feedback

Baloo: A Large-Scale Hybrid Soft Robotic Torso for Whole-Arm Manipulation

Human‐Like Electronic Skin‐Integrated Soft Robotic Hand

Robust Anthropomorphic Robotic Manipulation through Biomimetic Distributed Compliance

Arm Robot: AR-Enhanced Embodied Control and Visualization for Intuitive Robot Arm Manipulation

Cognitive and motor compliance in intentional human-robot interaction

A Soft-Robotic Approach to Anthropomorphic Robotic Hand Dexterity

Teleoperation of an Anthropomorphic Robot Hand with a Metamorphic Palm and Tunable-Stiffness Soft Fingers.

Multijointed Pneumatic Soft Hand with Flexible Thenar

Human Interface for Teleoperated Object Manipulation with a Soft Growing Robot

A Wearable Upper Limb Exoskeleton for Intuitive Teleoperation of Anthropomorphic Manipulators

Sensing and Control of a Multi-Joint Soft Wearable Robot for Upper-Limb Assistance and Rehabilitation

An Anthropomorphic Musculoskeletal System with Soft Joint and Multifilament Pneumatic Artificial Muscles

Sensor Fusion-Based Anthropomorphic Control of a Robotic Arm

A Multi‐Module Sensing and Bi‐Directional HMI Integrating Interaction, Recognition, and Feedback for Intelligent Robots

Hardware Design and Learning-Based Software Architecture of Musculoskeletal Wheeled Robot Musashi-W for Real-World Applications

Design and Fabrication of a Soft Robotic Hand with Embedded Actuators and Sensors

Learning thin deformable object manipulation with a multi-sensory integrated soft hand