Abstract:The Dunhuang ancient manuscripts are an excellent and precious cultural heritage of humanity. However, due to their age, the vast majority of these treasures are damaged and fragmented. Faced with a wide range of sources and numerous fragments, the process of restoration generally involves two core elements: sibling fragments identification and fragment assembly. Currently, fragment restoration still heavily relies on manual labor. During the long practice, a consensus has been reached on the importance of edge features for not only assembly but also for identification. However, accurate extraction of edge features and their use for efficient identification requires extensive knowledge and strong memory. This is a challenge for the human brain. So that in previous studies, fragment edge features have been used for assembly validation but rarely for identification. Therefore, an edge matcher is proposed, working like a bloodhound, capable of "sniffing out" specific "flavors" in edge features and performing efficient sibling fragment identification accordingly, providing guidance when experts perform entity assembly subsequently. Firstly, the fragmented images are standardized. Secondly, traditional methods are used to compress the representation of fragment edges and obtain paired local edge images. Finally, these images are fed into the edge matcher for classification discrimination, which is a CNN-based pairwise similarity metric model proposed in this paper, introducing residual blocks and depthwise separable convolutions, and adding multi-scale convolutional layers. With the edge matcher, a complex matching problem is successfully transformed into a simple classification problem. In the absence of a standard public dataset, a Dunhuang manuscript fragment edge dataset is constructed. Experiments are conducted on that dataset, and the accuracy, precision, recall, and F1 scores of the edge matcher all exceeded 97%. The effectiveness of the edge matcher is demonstrated by comparative experiments, and the rationality of the method design is verified by ablation experiments. The method combines traditional methods and deep learning methods to creatively use the edge geometric features of fragments for sibling fragment identification in a natural rather than coded way, making full use of the computer's computational and memory capabilities. The edge matcher can significantly reduce the time and scope of searching, matching, and inferring fragments, and assist in the reconstruction of Dunhuang ancient manuscript fragments.

Internal Similarity Network for Rejoining Oracle Bone Fragment Images.

Deep Rejoining Model for Oracle Bone Fragment Image.

Research on Rejoining Bone Stick Fragment Images: A Method Based on Multi-Scale Feature Fusion Siamese Network Guided by Edge Contour

The Research on Rejoining of the Oracle Bone Rubbings Based on Curve Matching

Oracle Bone Script Similiar Character Screening Approach Based on Simsiam Contrastive Learning and Supervised Learning

Image Segmentation and Recognition of Oracle Bone Topographies Based on Deep Learning

Image Stitching Method of Bone Stick Fragment Based on Similarity Freeman Code Matching

Applications of Convolutional Neural Networks to Extracting Oracle Bone Inscriptions from Three-Dimensional Models

Automatic Segmentation of Oracle Bone Inscriptions Using YOLOv8

Unsupervised Structure-Texture Separation Network for Oracle Character Recognition

An Oracle Bone Inscriptions Detection Algorithm Based on Improved YOLOv8

Reunion helper: an edge matcher for sibling fragment identification of the Dunhuang manuscript

Interactive semantics neural networks for skeleton-based human interaction recognition

Extended Gaussian Sphere and Similarity Fusion Method for Reassembly of 3D Cultural Relics

Image Semantic Analysis in Visual Media Art Using Machine Learning and Neural Machine Translation

A Cross-Font Image Retrieval Network for Recognizing Undeciphered Oracle Bone Inscriptions

Research on automatic segmentation and recognition of original topographic single characters based on intelligent recognition of oracle bones

2D Irregular Fragment Reassembly With Deep Learning Assistance

Linking unknown characters via oracle bone inscriptions retrieval

An automatic segmentation algorithm for conglutinated bone fragments in 3D CT images of lower limb fractures based on morphology

High Similarity Image Recognition and Classification Algorithm Based on Convolutional Neural Network