Abstract:Grasp generation aims to create complex hand-object interactions with a specified object. While traditional approaches for hand generation have primarily focused on visibility and diversity under scene constraints, they tend to overlook the fine-grained hand-object interactions such as contacts, resulting in inaccurate and undesired grasps. To address these challenges, we propose a controllable grasp generation task and introduce ClickDiff, a controllable conditional generation model that leverages a fine-grained Semantic Contact Map (SCM). Particularly when synthesizing interactive grasps, the method enables the precise control of grasp synthesis through either user-specified or algorithmically predicted Semantic Contact Map. Specifically, to optimally utilize contact supervision constraints and to accurately model the complex physical structure of hands, we propose a Dual Generation Framework. Within this framework, the Semantic Conditional Module generates reasonable contact maps based on fine-grained contact information, while the Contact Conditional Module utilizes contact maps alongside object point clouds to generate realistic grasps. We evaluate the evaluation criteria applicable to controllable grasp generation. Both unimanual and bimanual generation experiments on GRAB and ARCTIC datasets verify the validity of our proposed method, demonstrating the efficacy and robustness of ClickDiff, even with previously unseen objects. Our code is available at <a class="link-external link-https" href="https://github.com/adventurer-w/ClickDiff" rel="external noopener nofollow">this https URL</a>.

ContactGen: Generative Contact Modeling for Grasp Generation

Learning Object Affordance with Contact and Grasp Generation

Contact2Grasp: 3D Grasp Synthesis via Hand-Object Contact Constraint

ContactGen: Contact-Guided Interactive 3D Human Generation for Partners

ClickDiff: Click to Induce Semantic Contact Map for Controllable Grasp Generation with Diffusion Models

RegionGrasp: A Novel Task for Contact Region Controllable Hand Grasp Generation

GrainGrasp: Dexterous Grasp Generation with Fine-grained Contact Guidance

Learning a Contact Potential Field for Modeling the Hand-Object Interaction

NL2Contact: Natural Language Guided 3D Hand-Object Contact Modeling with Diffusion Model

Design And Use Of An Apparatus For Presenting Graspable Objects In 3d Workspace

D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactions

CMG-Net: An End-to-End Contact-Based Multi-Finger Dexterous Grasping Network

SAGA: Stochastic Whole-Body Grasping with Contact

UGG: Unified Generative Grasping

Contact Edit: Artist Tools for Intuitive Modeling of Hand-Object Interactions

Grasp Quality Evaluation Network for Surface-to-Surface Contacts in Point Clouds

ManiFoundation Model for General-Purpose Robotic Manipulation of Contact Synthesis with Arbitrary Objects and Robots

AO-Grasp: Articulated Object Grasp Generation

DVGG: Deep Variational Grasp Generation for Dextrous Manipulation

GraspDiff: Grasping Generation for Hand-Object Interaction With Multimodal Guided Diffusion

FastGrasp: Efficient Grasp Synthesis with Diffusion