Abstract:The Dunhuang murals, notably the paintings on the interior walls of China's Dunhuang Grottoes, are considered international cultural treasure. The Dunhuang murals were ruined to varied degrees after a lengthy period of erosion. Deep learning networks were utilized to reconstruct broken parts of murals in order to better preserve their important historical and cultural values. Due to the presence of various damages, such as large peeling, mold and scratches, and multi-scale objects in the mural, a simple porting of existing working methods is suboptimal. In this paper, we propose a progressive Dunhuang murals inpainting (PDMI) based on recurrent feature reasoning network to progressively infer the pixel values of hole centers by a progressive approach, aiming to obtain visually reasonable and semantically consistent inpainted results. PDMI consists mainly of the FFC-based recurrent feature reasoning (RFR) module and Multi-scale Knowledge Consistent Attention (MKCA) module. The RFR module first fills in the feature value at the feature map's hole border, then utilizes the obtained feature value as a clue for further inference. The module steadily improved the limitation of hole centers, making the inpainted results more explicit; MKCA enables feature maps in RFR to handle richer background information from distant location information in a flexible manner while preventing misuse. After several round-robin inferences provide multiple feature maps, these feature maps are fused using an adaptive feature weighted fusion mechanism, then the fused feature maps decode back to RGB image. Experiments on a publicly available dataset and a self-made Dunhuang mural dataset reveal that the proposed method outperforms the comparison algorithm in both qualitative and quantitative aspects.

Constructing a mobile visual search framework for Dunhuang murals based on fine-tuned CNN and ontology semantic distance

Mobile visual search model for Dunhuang murals in the smart library

Aesthetic Visual Style Assessment on Dunhuang Murals

Image Stitching and Blending of Dunhuang Murals Based on Image Pyramid

Large area interactive browsing for high resolution digitized dunhuang murals

Composition Based Semantic Scene Retrieval For Ancient Murals

Composition Analysis-Based Relevance Ranking for Ancient Mural

Localizing Artistic Objects in Frescos Through Contour Based Features

Computer Aided Protection and Restoration of Dunhuang Mural

Application of knowledge discovery in ancient mural exhibition

Content And Semantic-Based Image Retrieval For The Preservation, Restoration And Pattern Creation Of Dunhuang Fresco

Virtual Completion of Facial Image in Ancient Murals

Virtual Dunhuang Mural Restoration System in Collaborative Network Environment

Exploring the topic evolution of Dunhuang murals through image classification

Dunhuang murals contour generation network based on convolution and self-attention fusion

Application of cultural elements of dunhuang murals in landscape design based on mean shift algorithm extraction

Exploring the visual distinguishability and topic autocorrelation of murals unearthed in China from the spatial perspective

Dunhuang Mural Line Drawing Based on Bi-Dexined Network and Adaptive Weight Learning.

DunHuangStitch: Unsupervised Deep Image Stitching of Dunhuang Murals

Dunhuang Mural Line Drawing Based on Multi-scale Feature Fusion and Sharp Edge Learning

Progressive Dunhuang murals inpainting based on recurrent feature reasoning network