Abstract:The Dunhuang ancient manuscripts are an excellent and precious cultural heritage of humanity. However, due to their age, the vast majority of these treasures are damaged and fragmented. Faced with a wide range of sources and numerous fragments, the process of restoration generally involves two core elements: sibling fragments identification and fragment assembly. Currently, fragment restoration still heavily relies on manual labor. During the long practice, a consensus has been reached on the importance of edge features for not only assembly but also for identification. However, accurate extraction of edge features and their use for efficient identification requires extensive knowledge and strong memory. This is a challenge for the human brain. So that in previous studies, fragment edge features have been used for assembly validation but rarely for identification. Therefore, an edge matcher is proposed, working like a bloodhound, capable of "sniffing out" specific "flavors" in edge features and performing efficient sibling fragment identification accordingly, providing guidance when experts perform entity assembly subsequently. Firstly, the fragmented images are standardized. Secondly, traditional methods are used to compress the representation of fragment edges and obtain paired local edge images. Finally, these images are fed into the edge matcher for classification discrimination, which is a CNN-based pairwise similarity metric model proposed in this paper, introducing residual blocks and depthwise separable convolutions, and adding multi-scale convolutional layers. With the edge matcher, a complex matching problem is successfully transformed into a simple classification problem. In the absence of a standard public dataset, a Dunhuang manuscript fragment edge dataset is constructed. Experiments are conducted on that dataset, and the accuracy, precision, recall, and F1 scores of the edge matcher all exceeded 97%. The effectiveness of the edge matcher is demonstrated by comparative experiments, and the rationality of the method design is verified by ablation experiments. The method combines traditional methods and deep learning methods to creatively use the edge geometric features of fragments for sibling fragment identification in a natural rather than coded way, making full use of the computer's computational and memory capabilities. The edge matcher can significantly reduce the time and scope of searching, matching, and inferring fragments, and assist in the reconstruction of Dunhuang ancient manuscript fragments.

Gmd: Gaussian mixture descriptor for pair matching of 3D fragments

Matching 3D Models with Global Geometric Feature Map

Extended Gaussian Sphere and Similarity Fusion Method for Reassembly of 3D Cultural Relics

A 3D Scan Matching Method Based On Multi-Layered Normal Distribution Transform

MM-Gaussian: 3D Gaussian-based Multi-modal Fusion for Localization and Reconstruction in Unbounded Scenes

3D object reassembly using region-pair-relation and balanced cluster tree

Non-Rigid Point Set Registration Using Multi-Feature and Gaussian Mixture Model

GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction

Matching Algorithm for 3D Point Cloud Recognition and Registration Based on Multi-Statistics Histogram Descriptors

Feature-guided Gaussian Mixture Model for Image Matching.

GMF: General Multimodal Fusion Framework for Correspondence Outlier Rejection

3D Multi-Layered Normal Distribution Transform for Fast and Long Range Scan Matching

Global Patch Matching (GPM) for Freehand 3D Ultrasound Reconstruction

Leveraging photogrammetric mesh models for aerial-ground feature point matching toward integrated 3D reconstruction

Reunion helper: an edge matcher for sibling fragment identification of the Dunhuang manuscript

Application of Three-Dimensional Laser Scanning in the Protection of Multi-Dynasty Ceramic Fragments.

Shape-aware Surface Reconstruction from Sparse 3D Point-Clouds

A Coarse-to-Fine Algorithm for Matching and Registration in 3D Cross-Source Point Clouds

A Point Pairing Method for 3D Partial Shape Matching

A Probabilistic Method for Fractured Cultural Relics Automatic Reassembly

Learning to fuse local geometric features for 3D rigid data matching