Abstract:The ability of robots to navigate through doors is crucial for their effective operation in indoor environments. Consequently, extensive research has been conducted to develop robots capable of opening specific doors. However, the diverse combinations of door handles and opening directions necessitate a more versatile door opening system for robots to successfully operate in real-world environments. In this paper, we propose a mobile manipulator system that can autonomously open various doors without prior knowledge. By using convolutional neural networks, point cloud extraction techniques, and external force measurements during exploratory motion, we obtained information regarding handle types, poses, and door characteristics. Through two different approaches, adaptive position-force control and deep reinforcement learning, we successfully opened doors without precise trajectory or excessive external force. The adaptive position-force control method involves moving the end-effector in the direction of the door opening while responding compliantly to external forces, ensuring safety and manipulator workspace. Meanwhile, the deep reinforcement learning policy minimizes applied forces and eliminates unnecessary movements, enabling stable operation across doors with different poses and widths. The RL-based approach outperforms the adaptive position-force control method in terms of compensating for external forces, ensuring smooth motion, and achieving efficient speed. It reduces the maximum force required by 3.27 times and improves motion smoothness by 1.82 times. However, the non-learning-based adaptive position-force control method demonstrates more versatility in opening a wider range of doors, encompassing revolute doors with four distinct opening directions and varying widths.

SAR-PPO(Segmented Adaptive Reward): Robotic Arm Open Door Motion Control With Reinforcement Learning Based on Segmented Adaptive Reward

Mobile Robotic Arm for Opening Doors Using Proximal Policy Optimization

Research on Door Opening Operation of Mobile Robotic Arm Based on Reinforcement Learning

Research on the opening method of robotic arm based on force feedback reinforcement learning

Simulation of Robotic Arm Grasping Control Based on Proximal Policy Optimization Algorithm

A Versatile Door Opening System with Mobile Manipulator through Adaptive Position-Force Control and Reinforcement Learning

Open-Loop Motion Control of a Hydraulic Soft Robotic Arm Using Deep Reinforcement Learning

Robotic Arm Motion Planning Based on Curriculum Reinforcement Learning

Learning Semantic Keypoint Representations for Door Opening Manipulation

Robotic arm trajectory tracking method based on improved proximal policy optimization

Leveraging Efficiency Through Hybrid Prioritized Experience Replay in Door Environment.

Optimizing Deep Reinforcement Learning for Adaptive Robotic Arm Control

Door opening by joining reinforcement learning and intelligent control

Robust and adaptive door operation with a mobile robot

A Portable Accelerator of Proximal Policy Optimization for Robots

Learning adaptive manipulation of objects with revolute joint: A case study on varied cabinet doors opening

DoorGym: A Scalable Door Opening Environment And Baseline Agent

PORF-DDPG: Learning Personalized Autonomous Driving Behavior with Progressively Optimized Reward Function

An obstacle avoidance method for robotic arm based on reinforcement learning

Learning to Open and Traverse Doors with a Legged Manipulator

Learning of Long-Horizon Sparse-Reward Robotic Manipulator Tasks With Base Controllers