Abstract:The Dunhuang ancient manuscripts are an excellent and precious cultural heritage of humanity. However, due to their age, the vast majority of these treasures are damaged and fragmented. Faced with a wide range of sources and numerous fragments, the process of restoration generally involves two core elements: sibling fragments identification and fragment assembly. Currently, fragment restoration still heavily relies on manual labor. During the long practice, a consensus has been reached on the importance of edge features for not only assembly but also for identification. However, accurate extraction of edge features and their use for efficient identification requires extensive knowledge and strong memory. This is a challenge for the human brain. So that in previous studies, fragment edge features have been used for assembly validation but rarely for identification. Therefore, an edge matcher is proposed, working like a bloodhound, capable of "sniffing out" specific "flavors" in edge features and performing efficient sibling fragment identification accordingly, providing guidance when experts perform entity assembly subsequently. Firstly, the fragmented images are standardized. Secondly, traditional methods are used to compress the representation of fragment edges and obtain paired local edge images. Finally, these images are fed into the edge matcher for classification discrimination, which is a CNN-based pairwise similarity metric model proposed in this paper, introducing residual blocks and depthwise separable convolutions, and adding multi-scale convolutional layers. With the edge matcher, a complex matching problem is successfully transformed into a simple classification problem. In the absence of a standard public dataset, a Dunhuang manuscript fragment edge dataset is constructed. Experiments are conducted on that dataset, and the accuracy, precision, recall, and F1 scores of the edge matcher all exceeded 97%. The effectiveness of the edge matcher is demonstrated by comparative experiments, and the rationality of the method design is verified by ablation experiments. The method combines traditional methods and deep learning methods to creatively use the edge geometric features of fragments for sibling fragment identification in a natural rather than coded way, making full use of the computer's computational and memory capabilities. The edge matcher can significantly reduce the time and scope of searching, matching, and inferring fragments, and assist in the reconstruction of Dunhuang ancient manuscript fragments.

2D Irregular Fragment Reassembly With Deep Learning Assistance

A Probabilistic Method for Fractured Cultural Relics Automatic Reassembly

Hierarchical and Efficient Learning for Person Re-Identification

3D object reassembly using region-pair-relation and balanced cluster tree

PuzzleFixer: A Visual Reassembly System for Immersive Fragments Restoration

Jigsaw: Learning to Assemble Multiple Fractured Objects

Reunion helper: an edge matcher for sibling fragment identification of the Dunhuang manuscript

Image Reassembly Combining Deep Learning and Shortest Path Problem

PuzzleFusion++: Auto-agglomerative 3D Fracture Assembly by Denoise and Verify

A Fragment Fracture Surface Segmentation Method Based on Learning of Local Geometric Features on Margins Used for Automatic Utensil Reassembly

FragmentDiff: A Diffusion Model for Fractured Object Assembly

JigsawNet: Shredded Image Reassembly Using Convolutional Neural Network and Loop-Based Composition

DiffAssemble: A Unified Graph-Diffusion Model for 2D and 3D Reassembly

Scalable Geometric Fracture Assembly via Co-creation Space among Assemblers

Visual Odometry Based 3D-Reconstruction

Batch-based Model Registration for Fast 3D Sherd Reconstruction

Jigsaw Puzzle Solving Using Local Feature Co-Occurrences in Deep Neural Networks

Gmd: Gaussian mixture descriptor for pair matching of 3D fragments

Divide-and-Assemble: Learning Block-wise Memory for Unsupervised Anomaly Detection

A Survey on Computational Solutions for Reconstructing Complete Objects by Reassembling Their Fractured Parts

Reassembling Broken Objects using Breaking Curves