Abstract:A versatile robot working in a domestic environment based on a deep neural network (DNN) is currently attracting attention. One of the roles expected for domestic robots is caregiving for a human. In particular, we focus on repositioning care because repositioning plays a fundamental role in supporting the health and quality of life of individuals with limited mobility. However, generating motions of the repositioning care, avoiding applying force to non-target parts and applying appropriate force to target parts, remains challenging. In this study, we proposed a DNN-based architecture using visual and somatosensory attention mechanisms that can generate dual-arm repositioning motions which involve different sequential policies of interaction force; contact-less reaching and contact-based assisting motions. We used the humanoid robot Dry-AIREC, which features the capability to adjust joint impedance dynamically. In the experiment, the repositioning assistance from the supine position to the sitting position was conducted by Dry-AIREC. The trained model, utilizing the proposed architecture, successfully guided the robot's hand to the back of the mannequin without excessive contact force on the mannequin and provided adequate support and appropriate contact for postural adjustment.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to use deep neural networks (DNN) to generate dual - arm re - positioning actions suitable for nursing tasks in a home environment, especially to avoid applying force to non - target parts and apply appropriate force to target parts. Specifically, the paper focuses on supporting the health and quality of life of individuals with limited mobility through re - positioning. This process requires that the robot can: 1. **Distinguish targets and apply force only to target points**: When performing nursing tasks, the robot needs to be able to identify which parts are the target parts that need to be contacted and which are non - target parts, so as to avoid unnecessary touches or injuries. 2. **Apply an appropriate amount of force to the nursing object**: When providing care, the robot must be able to adjust the magnitude of the applied force according to the needs of the task. It should not be too light to complete the task, nor too heavy to cause harm. 3. **Handle occlusion and changes in spatial relationships**: When performing the re - positioning task, the nursing object may be occluded by the robot's arm, or the robot's arm may be occluded by the nursing object. This requires the robot to be able to adapt to these changes. 4. **Continuously execute different contact strategies**: The re - positioning task consists of two stages, namely reaching the target point (before contact) and assisting in lifting the upper body (after contact). Each stage requires different contact methods. Therefore, the robot needs to be able to continuously execute different contact strategies during the task. To achieve the above goals, the paper proposes a DNN - based method that combines visual and somatosensory attention mechanisms to generate dual - arm re - positioning actions that need to apply force to target points while avoiding non - target points. In the experiment, the Dry - AIREC humanoid robot was used. This robot has the ability to dynamically adjust joint impedance and can more flexibly respond to nursing needs in different scenarios.

Dual-arm Motion Generation for Repositioning Care based on Deep Predictive Learning with Somatosensory Attention Mechanism

Dynamic Movement Primitive Based Motion Retargeting for Dual-Arm Sign Language Motions

An IoT-Enabled Telerobotic-Assisted Healthcare System Based on Inertial Motion Capture.

Multimodal Reaching-Position Prediction for ADL Support Using Neural Networks

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

Learning-Based Motion-Intention Prediction for End-Point Control of Upper-Limb-Assistive Robots

Spatial Attention Point Network for Deep-learning-based Robust Autonomous Robot Motion Generation

A Multitasking-Oriented Robot Arm Motion Planning Scheme Based on Deep Reinforcement Learning and Twin Synchro-Control

Cooperative Manipulation for a Mobile Dual-Arm Robot Using Sequences of Dynamic Movement Primitives

IoT-Enabled Dual-Arm Motion Capture and Mapping for Telerobotics in Home Care

Reinforcement learning of dual-arm cooperation for a mobile manipulator with sequences of dynamical movement primitives

A Model Predictive Approach for Online Mobile Manipulation of Nonholonomic Objects using Learned Dynamics

Motion Planning and Cooperative Manipulation for Mobile Robots with Dual Arms

Transhumeral Arm Reaching Motion Prediction through Deep Reinforcement Learning-Based Synthetic Motion Cloning

Dual-Arm Robot Trajectory Planning Based on Deep Reinforcement Learning under Complex Environment

Motion Planning for Dual-Arm Robot Based on Soft Actor-Critic

Predictive Multi-Agent-Based Planning and Landing Controller for Reactive Dual-Arm Manipulation

Motion planning framework based on dual-agent DDPG method for dual-arm robots guided by human joint angle constraints