Abstract:Recent progress in robotic manipulation has dealt with the case of previously unknown objects in the context of relatively simple tasks, such as bin-picking. Existing methods for more constrained problems, however, such as deliberate placement in a tight region, depend more critically on shape information to achieve safe execution. This work deals with pick-and-constrained placement of objects without access to geometric models. The objective is to pick an object and place it safely inside a desired goal region without any collisions, while minimizing the time and the sensing operations required to complete the task. An algorithmic framework is proposed for this purpose, which performs manipulation planning simultaneously over a conservative and an optimistic estimate of the object's volume. The conservative estimate ensures that the manipulation is safe while the optimistic estimate guides the sensor-based manipulation process when no solution can be found for the conservative estimate. To maintain these estimates and dynamically update them during manipulation, objects are represented by a simple volumetric representation, which stores sets of occupied and unseen voxels. The effectiveness of the proposed approach is demonstrated by developing a robotic system that picks a previously unseen object from a table-top and places it in a constrained space. The system comprises of a dual-arm manipulator with heterogeneous end-effectors and leverages hand-offs as a re-grasping strategy. Real-world experiments show that straightforward pick-sense-and-place alternatives frequently fail to solve pick-and-constrained placement problems. The proposed pipeline, however, achieves more than 95% success rate and faster execution times as evaluated over multiple physical experiments.

Action Planning for Packing Long Linear Elastic Objects into Compact Boxes with Bimanual Robotic Manipulation

Tight Robot Packing in the Real World: A Complete Manipulation Pipeline with Robust Primitives

A Method of Tight Placement for Robotic Dense Packing

Stable bin packing of non-convex 3D objects with a robot manipulator

Planning for quasi-static manipulation tasks via an intrinsic haptic metric

Hierarchical Planning and Control for Box Loco-Manipulation

Rearranging Deformable Linear Objects for Implicit Goals with Self-Supervised Planning and Control

Planning Irregular Object Packing Via Hierarchical Reinforcement Learning

Object Rearrangement with Nested Nonprehensile Manipulation Actions

Keypoint-Based Planar Bimanual Shaping of Deformable Linear Objects under Environmental Constraints with Hierarchical Action Framework

BOMP: Bin-Optimized Motion Planning

Task-driven Perception and Manipulation for Constrained Placement of Unknown Objects

Object-Centric Kinodynamic Planning for Nonprehensile Robot Rearrangement Manipulation

Revolutionizing Packaging: A Robotic Bagging Pipeline with Constraint-aware Structure-of-Interest Planning

Novel objects 3-D dense packing through robotic pushing

Learning Physically Realizable Skills for Online Packing of General 3D Shapes

Robot Online 3D Bin Packing Strategy Based on Deep Reinforcement Learning and 3D Vision

Learning the Sequence of Packing Irregular Objects from Human Demonstrations: Towards Autonomous Packing Robots

Preparatory Manipulation Planning using Automatically Determined Single and Dual Arms

Towards reliable robot packing system based on deep reinforcement learning