Abstract:The International Journal of Robotics Research, Ahead of Print. This study proposes a modularized soft robotic arm with integrated sensing of human touches for physical human–robot interactions. The proposed robotic arm is constructed by connecting multiple soft manipulator modules, each of which consists of three bellow-type soft actuators, pneumatic valves, and an on-board sensing and control circuit. By employing stereolithography three-dimensional (3D) printing technique, the bellow actuator is capable of incorporating embedded organogel channels in the thin wall of its body that are used for detecting human touches. The organogel thus serves as a soft interface for recognizing the intentions of the human operators, enabling the robot to interact with them while generating desired motions of the manipulator. In addition to the touch sensors, each manipulator module has compact, soft string sensors for detecting the displacements of the bellow actuators. When combined with an inertial measurement unit (IMU), the manipulator module has a capability of estimating its own pose or orientation internally. We also propose a localization method that allows us to estimate the location of the manipulator module and to acquire the 3D information of the target point in an uncontrolled environment. The proposed method uses only a single depth camera combined with a deep learning model and is thus much simpler than those of conventional motion capture systems that usually require multiple cameras in a controlled environment. Using the feedback information from the internal sensors and camera, we implemented closed-loop control algorithms to carry out tasks of reaching and grasping objects. The manipulator module shows structural robustness and the performance reliability over 5,000 cycles of repeated actuation. It shows a steady-state error and a standard deviation of 0.8 mm and 0.3 mm, respectively, using the proposed localization method and the string sensor data. We demonstrate an application example of human–robot interaction that uses human touches as triggers to pick up and manipulate target objects. The proposed soft robotic arm can be easily installed in a variety of human workspaces, since it has the ability to interact safely with humans, eliminating the need for strict control of the environments for visual perception. We believe that the proposed system has the potential to integrate soft robots into our daily lives.

A Modular Software Framework for Eye–Hand Coordination in Humanoid Robots

Beyond End-Effector: Utilizing High-Resolution Tactile Signals for Physical Human–Robot Interaction

Enhancing Human–Robot Collaboration through a Multi-Module Interaction Framework with Sensor Fusion: Object Recognition, Verbal Communication, User of Interest Detection, Gesture and Gaze Recognition

HARMONIOUS -- Human-like reactive motion control and multimodal perception for humanoid robots

A Modular Framework for Flexible Planning in Human-Robot Collaboration

Learning robotic eye–arm–hand coordination from human demonstration: a coupled dynamical systems approach

iCub-HRI: A Software Framework for Complex Human-Robot Interaction Scenarios on the iCub Humanoid Robot

Design and Implementation of a Human-Robot Joint Action Framework using Augmented Reality and Eye Gaze

A Complementary Framework for Human-Robot Collaboration with a Mixed AR-Haptic Interface

Object-Independent Human-to-Robot Handovers Using Real Time Robotic Vision

An Embedded Framework for Fully Autonomous Object Manipulation in Robotic-Empowered Assisted Living

Soft modularized robotic arm for safe human–robot interaction based on visual and proprioceptive feedback

CobotGear: Interaction with Collaborative Robots using Wearable Optical Motion Capturing Systems

Hierarchical visuomotor control of humanoids

Design and Implementation of a Behavioral Sequence Framework for Human-robot Interaction Utilizing Brain-computer Interface and Haptic Feedback

Design of a Robotic Humanoid for Surveillance Application

Intuitive robot programming through environment perception, augmented reality simulation and automated program verification

Hold My Hand: Development of a Force Controller and System Architecture for Joint Walking with a Companion Robot

Human-Machine Interface for Remote Training of Robot Tasks

A Vision-Based Path Planning and Object Tracking Framework for 6-DOF Robotic Manipulator

A novel task-oriented framework for dual-arm robotic assembly task