Abstract:Robotic manipulation holds the potential to replace humans in the execution of tedious or dangerous tasks. However, control-based approaches are not suitable due to the difficulty of formally describing open-world manipulation in reality, and the inefficiency of existing learning methods. Thus, applying manipulation in a wide range of scenarios presents significant challenges. In this study, we propose a novel method for skill learning in robotic manipulation called Tactile Active Inference Reinforcement Learning (Tactile-AIRL), aimed at achieving efficient training. To enhance the performance of reinforcement learning (RL), we introduce active inference, which integrates model-based techniques and intrinsic curiosity into the RL process. This integration improves the algorithm's training efficiency and adaptability to sparse rewards. Additionally, we utilize a vision-based tactile sensor to provide detailed perception for manipulation tasks. Finally, we employ a model-based approach to imagine and plan appropriate actions through free energy minimization. Simulation results demonstrate that our method achieves significantly high training efficiency in non-prehensile objects pushing tasks. It enables agents to excel in both dense and sparse reward tasks with just a few interaction episodes, surpassing the SAC baseline. Furthermore, we conduct physical experiments on a gripper screwing task using our method, which showcases the algorithm's rapid learning capability and its potential for practical applications.

Leveraging Robotic Prior Tactile Exploratory Action Experiences For Learning New Objects's Physical Properties

Dexterous Manoeuvre Through Touch in a Cluttered Scene

DexTouch: Learning to Seek and Manipulate Objects with Tactile Dexterity

Lifelong Visual-Tactile Cross-Modal Learning for Robotic Material Perception

Progress on Flexible Tactile Sensors in Robotic Applications on Objects Properties Recognition, Manipulation and Human-Machine Interactions

Exploring CausalWorld: Enhancing robotic manipulation via knowledge transfer and curriculum learning

Crossing the Reality Gap in Tactile-Based Learning

Autonomous Learning of Page Flipping Movements via Tactile Feedback

Sim-to-Real Transfer for Robotic Manipulation with Tactile Sensory

Built Different: Tactile Perception to Overcome Cross-Embodiment Capability Differences in Collaborative Manipulation

Robot Synesthesia: In-Hand Manipulation with Visuotactile Sensing

Use of tactile feedback to control exploratory movements to characterize object compliance

Sim2Real Manipulation on Unknown Objects with Tactile-based Reinforcement Learning

MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulation

Fine Manipulation Using a Tactile Skin: Learning in Simulation and Sim-to-Real Transfer

Learning active tactile perception through belief-space control

Learning In-Hand Translation Using Tactile Skin With Shear and Normal Force Sensing

Learning Tactile Insertion in the Real World

Human-Touch-Inspired Material Recognition for Robotic Tactile Sensing

Soft Contact Simulation and Manipulation Learning of Deformable Objects with Vision-based Tactile Sensor

Tactile Active Inference Reinforcement Learning for Efficient Robotic Manipulation Skill Acquisition