FragmentDiff: A Diffusion Model for Fractured Object Assembly

Qun-Ce Xu,Hao-Xiang Chen,Jiacheng Hua,Xiaohua Zhan,Yong-Liang Yang,Tai-Jiang Mu

DOI: https://doi.org/10.1145/3680528.3687673

2024-01-01

Abstract:Fractured object reassembly is a challenging problem in computer vision and graphics with applications in industrial manufacturing and archaeology. Traditional methods based on shape descriptors and geometric registration often struggle with ambiguous features, resulting in lower accuracy. Recent data-driven methods are inherently affected by the representation and learning ability of the trained models. To address this, we propose a novel approach inspired by diffusion models and transformers. Our method applies diffusion denoising via a transformer to predict the pose parameter of each fragment, taking advantage of their global feature correlation and pose prior learning abilities. We evaluate our approach on a fractured object dataset and demonstrate superior performance compared to state-of-the-art methods. Our method offers a promising solution for accurate and robust fractured object reassembly, advancing the field in complex shape analysis and assembly tasks.