Abstract:The Dunhuang ancient manuscripts are an excellent and precious cultural heritage of humanity. However, due to their age, the vast majority of these treasures are damaged and fragmented. Faced with a wide range of sources and numerous fragments, the process of restoration generally involves two core elements: sibling fragments identification and fragment assembly. Currently, fragment restoration still heavily relies on manual labor. During the long practice, a consensus has been reached on the importance of edge features for not only assembly but also for identification. However, accurate extraction of edge features and their use for efficient identification requires extensive knowledge and strong memory. This is a challenge for the human brain. So that in previous studies, fragment edge features have been used for assembly validation but rarely for identification. Therefore, an edge matcher is proposed, working like a bloodhound, capable of "sniffing out" specific "flavors" in edge features and performing efficient sibling fragment identification accordingly, providing guidance when experts perform entity assembly subsequently. Firstly, the fragmented images are standardized. Secondly, traditional methods are used to compress the representation of fragment edges and obtain paired local edge images. Finally, these images are fed into the edge matcher for classification discrimination, which is a CNN-based pairwise similarity metric model proposed in this paper, introducing residual blocks and depthwise separable convolutions, and adding multi-scale convolutional layers. With the edge matcher, a complex matching problem is successfully transformed into a simple classification problem. In the absence of a standard public dataset, a Dunhuang manuscript fragment edge dataset is constructed. Experiments are conducted on that dataset, and the accuracy, precision, recall, and F1 scores of the edge matcher all exceeded 97%. The effectiveness of the edge matcher is demonstrated by comparative experiments, and the rationality of the method design is verified by ablation experiments. The method combines traditional methods and deep learning methods to creatively use the edge geometric features of fragments for sibling fragment identification in a natural rather than coded way, making full use of the computer's computational and memory capabilities. The edge matcher can significantly reduce the time and scope of searching, matching, and inferring fragments, and assist in the reconstruction of Dunhuang ancient manuscript fragments.

Fragment Re-Assembly Based on LCS Matching

Free Form Surface Matching Using Motion Consistency

3D Shape Matching Using Collinearity Constraint

A semi-automatic deshredding method based on curve matching

Matching Images Based on Consistency Graph and Region Adjacency Graphs.

A Probabilistic Method for Fractured Cultural Relics Automatic Reassembly

2D Irregular Fragment Reassembly With Deep Learning Assistance

3D object reassembly using region-pair-relation and balanced cluster tree

3D object retrieval by bipartite matching

Recurring Part Arrangements in Shape Collections

A Novel SFP Extracting/Tracking Framework for Rigid Microstructure Measurement

Complementary Part Detection and Reassembly of 3D Fragments

A Fragment Fracture Surface Segmentation Method Based on Learning of Local Geometric Features on Margins Used for Automatic Utensil Reassembly

Scalable Geometric Fracture Assembly via Co-creation Space among Assemblers

FragmentDiff: A Diffusion Model for Fractured Object Assembly

Reassembling Broken Objects using Breaking Curves

PuzzleFusion++: Auto-agglomerative 3D Fracture Assembly by Denoise and Verify

Gmd: Gaussian mixture descriptor for pair matching of 3D fragments

TC-SfM: Robust Track-Community-Based Structure-from-Motion

A Survey on Computational Solutions for Reconstructing Complete Objects by Reassembling Their Fractured Parts

Reunion helper: an edge matcher for sibling fragment identification of the Dunhuang manuscript