Abstract:The ability of robots to navigate through doors is crucial for their effective operation in indoor environments. Consequently, extensive research has been conducted to develop robots capable of opening specific doors. However, the diverse combinations of door handles and opening directions necessitate a more versatile door opening system for robots to successfully operate in real-world environments. In this paper, we propose a mobile manipulator system that can autonomously open various doors without prior knowledge. By using convolutional neural networks, point cloud extraction techniques, and external force measurements during exploratory motion, we obtained information regarding handle types, poses, and door characteristics. Through two different approaches, adaptive position-force control and deep reinforcement learning, we successfully opened doors without precise trajectory or excessive external force. The adaptive position-force control method involves moving the end-effector in the direction of the door opening while responding compliantly to external forces, ensuring safety and manipulator workspace. Meanwhile, the deep reinforcement learning policy minimizes applied forces and eliminates unnecessary movements, enabling stable operation across doors with different poses and widths. The RL-based approach outperforms the adaptive position-force control method in terms of compensating for external forces, ensuring smooth motion, and achieving efficient speed. It reduces the maximum force required by 3.27 times and improves motion smoothness by 1.82 times. However, the non-learning-based adaptive position-force control method demonstrates more versatility in opening a wider range of doors, encompassing revolute doors with four distinct opening directions and varying widths.

Mobile Robotic Arm for Opening Doors Using Proximal Policy Optimization

Research on Door Opening Operation of Mobile Robotic Arm Based on Reinforcement Learning

SAR-PPO(Segmented Adaptive Reward): Robotic Arm Open Door Motion Control With Reinforcement Learning Based on Segmented Adaptive Reward

Dynamical Obstacle Avoidance of Task- Constrained Mobile Manipulation Using Model Predictive Control

Simulation of Robotic Arm Grasping Control Based on Proximal Policy Optimization Algorithm

Visualized Trajectory Planning of Flexible Redundant Robotic Arm Using A Novel Hybrid Algorithm

Intelligent Control for a Non-holonomic Constrained Mobile Robot with Proximal Policy Optimization

A Versatile Door Opening System with Mobile Manipulator through Adaptive Position-Force Control and Reinforcement Learning

Research on the opening method of robotic arm based on force feedback reinforcement learning

Open-Loop Motion Control of a Hydraulic Soft Robotic Arm Using Deep Reinforcement Learning

Robust and adaptive door operation with a mobile robot

Robotic arm trajectory tracking method based on improved proximal policy optimization

Door Opening and Closing Considering Forces Using a Mobile Manipulator with an Admittance Controlled Arm

A Portable Accelerator of Proximal Policy Optimization for Robots

Robust Adaptive Control of Door Opening by a Mobile Rescue Manipulator Based on Unknown-Force-related Constraints Estimation.

A Path Planning Algorithm Based on Deep Reinforcement Learning for Mobile Robots in Unknown Environment

An Intelligent Robot Motion Planning Method and Application Via LPPO in Unknown Environment

A Novel Planning and Tracking Approach for Mobile Robotic Arm in Obstacle Environment

A manipulability improving scheme for opening unknown doors with mobile manipulator

Enhancement of Control Performance for Degraded Robot Manipulators Using Digital Twin and Proximal Policy Optimization

Self-protective motion planning for mobile manipulators in a dynamic door-closing workspace