Abstract:The Dunhuang murals, notably the paintings on the interior walls of China's Dunhuang Grottoes, are considered international cultural treasure. The Dunhuang murals were ruined to varied degrees after a lengthy period of erosion. Deep learning networks were utilized to reconstruct broken parts of murals in order to better preserve their important historical and cultural values. Due to the presence of various damages, such as large peeling, mold and scratches, and multi-scale objects in the mural, a simple porting of existing working methods is suboptimal. In this paper, we propose a progressive Dunhuang murals inpainting (PDMI) based on recurrent feature reasoning network to progressively infer the pixel values of hole centers by a progressive approach, aiming to obtain visually reasonable and semantically consistent inpainted results. PDMI consists mainly of the FFC-based recurrent feature reasoning (RFR) module and Multi-scale Knowledge Consistent Attention (MKCA) module. The RFR module first fills in the feature value at the feature map's hole border, then utilizes the obtained feature value as a clue for further inference. The module steadily improved the limitation of hole centers, making the inpainted results more explicit; MKCA enables feature maps in RFR to handle richer background information from distant location information in a flexible manner while preventing misuse. After several round-robin inferences provide multiple feature maps, these feature maps are fused using an adaptive feature weighted fusion mechanism, then the fused feature maps decode back to RGB image. Experiments on a publicly available dataset and a self-made Dunhuang mural dataset reveal that the proposed method outperforms the comparison algorithm in both qualitative and quantitative aspects.

Research on Dynasty Classification of Dunhuang Murals Based on Convolutional Neural Networks

Aesthetic Visual Style Assessment on Dunhuang Murals

Image Stitching and Blending of Dunhuang Murals Based on Image Pyramid

Exploring the topic evolution of Dunhuang murals through image classification

Dynasty recognition algorithm of an adaptive enhancement capsule network for ancient mural images

Ancient mural classification methods based on a multichannel separable network

Knowledge Based Lacunas Detection And Segmentation For Ancient Paintings

Mural Sketch Generation via Style-aware Convolutional Neural Network.

Dunhuang murals image restoration method based on generative adversarial network

Virtual Dunhuang Mural Restoration System in Collaborative Network Environment

Intelligent Computer Technology-Driven Mural Pattern Recognition Method

Virtual Completion of Facial Image in Ancient Murals

The Classification of Traditional Chinese Painting Based on CNN

Dunhuang murals contour generation network based on convolution and self-attention fusion

Progressive Dunhuang murals inpainting based on recurrent feature reasoning network

Application of knowledge discovery in ancient mural exhibition

Computer Aided Protection and Restoration of Dunhuang Mural

Large area interactive browsing for high resolution digitized dunhuang murals

Restoration of Dunhuang Murals on Large-scale pretraining

Constructing a mobile visual search framework for Dunhuang murals based on fine-tuned CNN and ontology semantic distance

Classification of Dunhuang Mural Image Based on Small-sample and Semi-supervised Learning