Abstract:When limited by their own morphologies, humans and some species of animals have the remarkable ability to use objects from the environment toward accomplishing otherwise impossible tasks. Robots might similarly unlock a range of additional capabilities through tool use. Recent techniques for jointly optimizing morphology and control via deep learning are effective at designing locomotion agents. But while outputting a single morphology makes sense for locomotion, manipulation involves a variety of strategies depending on the task goals at hand. A manipulation agent must be capable of rapidly prototyping specialized tools for different goals. Therefore, we propose learning a designer policy, rather than a single design. A designer policy is conditioned on task information and outputs a tool design that helps solve the task. A design-conditioned controller policy can then perform manipulation using these tools. In this work, we take a step towards this goal by introducing a reinforcement learning framework for jointly learning these policies. Through simulated manipulation tasks, we show that this framework is more sample efficient than prior methods in multi-goal or multi-variant settings, can perform zero-shot interpolation or fine-tuning to tackle previously unseen goals, and allows tradeoffs between the complexity of design and control policies under practical constraints. Finally, we deploy our learned policies onto a real robot. Please see our supplementary video and website at <a class="link-external link-https" href="https://robotic-tool-design.github.io/" rel="external noopener nofollow">this https URL</a> for visualizations.

Hierarchical Learning and Control for In-Hand Micromanipulation Using Multiple Laser-Driven Micro-Tools

Dexterous Manoeuvre Through Touch in a Cluttered Scene

Laser-Actuated Multi-Fingered Hand for Dexterous Manipulation of Micro-Objects

Automated Manipulation of Micro-Nano Objects with SPM by Using L1 Adaptive Controller

Learning Hierarchical Control for Robust In-Hand Manipulation

Non-contact Dexterous Micromanipulation with Multiple Optoelectronic Robots

Hybrid Learning- and Model-Based Planning and Control of In-Hand Manipulation

Non-Prehensile Tool-Object Manipulation by Integrating LLM-Based Planning and Manoeuvrability-Driven Controls

Design and Control of a Multi-Dof Micromanipulator Dedicated to Multiscale Micromanipulation

Hierarchical Tactile-Based Control Decomposition of Dexterous In-Hand Manipulation Tasks

Learning to Design and Use Tools for Robotic Manipulation

Continuous Multi-Target Approaching Control of Hyper-Redundant Manipulators Based on Reinforcement Learning

Deep learning-based control framework for dynamic contact processes in humanoid grasping

Opto-fluidically multiplexed assembly and micro-robotics

A Steady-Hand Robotic System for Microsurgical Augmentation

A remotely driven and controlled micro-gripper fabricated from light-induced deformation smart material

Multifingered Robot Hand Compliant Manipulation Based on Vision-Based Demonstration and Adaptive Force Control

Multi-target Approaching Control of Hyper-redundant Manipulators Using Reinforcement Learning

Contact-Implicit Model Predictive Control for Dexterous In-hand Manipulation: A Long-Horizon and Robust Approach

Learning thin deformable object manipulation with a multi-sensory integrated soft hand

Interaction Control for Tool Manipulation on Deformable Objects Using Tactile Feedback