Abstract:Ancient murals are important cultural heritages for our exploration of ancient civilizations and are of great research value. Due to long-time exposure to the environment, ancient murals often suffer from damage (deterioration) such as cracks, scratches, corrosion, paint loss, and even large-region falling off. It is an urgent work to protect and restore these damaged ancient murals. Mural inpainting techniques refer to virtually filling the deteriorated regions by reconstructing the structure and texture elements of the mural images. Most existing mural inpainting approaches fail to fill loss contents that contain complex structures and diverse patterns since they neglect the importance of structure guidance. In this paper, we propose a structure-guided two-branch model based on the generative adversarial network (GAN) for ancient mural inpainting. In the proposed model, the mural inpainting process can be divided into two stages: structure reconstruction and content restoration. These two stages are conducted by using a structure reconstruction network (SRN) and a content restoration network (CRN), respectively. In the structure reconstruction stage, SRN employs the Gated Convolution and the Fast Fourier Convolution (FFC) residual block to reconstruct the missing structures of the damaged murals. In the content restoration stage, CRN uses the structures (generated by SRN) to guide the missing content restoration of the murals. We design a two-branch parallel encoder to improve the texture and color restoration quality for the missing regions of the murals. Moreover, we propose a cascade attention module that can capture long-term relevance information in the deep features. It helps to alleviate the texture-blur and color-bias problem. We conduct experiments on both simulated and real damaged murals, and compare our inpainting results with other four competitive approaches. Experimental results show that our proposed model outperforms other approaches in terms of texture clarity, color consistency and structural continuity of the restored mural images. In addition, the mural inpainting results of our model can achieve comparatively high quantitative evaluation metrics.

Progressive Dunhuang Murals Inpainting Based on Attention Mechanism

Progressive Dunhuang murals inpainting based on recurrent feature reasoning network

A Priori-based Adaptive Repair Method for Mural Images

Image Inpainting Based on Gradient Weighted Patch Propagation and Color Rectification

Inpainting Digital Dunhuang Murals with Structure-Guided Deep Network

Multi-stage Progressive Reasoning for Dunhuang Murals Inpainting

Dunhuang mural inpainting based on reference guidance and multi‐scale fusion

Knowledge Based Lacunas Detection And Segmentation For Ancient Paintings

Virtual Completion of Facial Image in Ancient Murals

Dunhuang murals image restoration method based on generative adversarial network

Image Inpainting for Digital Dunhuang Murals Using Partial Convolutions and Sliding Window Method

Restoration of Dunhuang Murals on Large-scale pretraining

Biologic and Molecular Characteristics of Toxoplasma gondii Isolates From Striped Skunk (Mephitis mephitis), Canada Goose (Branta canadensis), Black-Winged Lory (Eos cyanogenia), and Cats (Felis catus)

Line Drawing Guided Progressive Inpainting of Mural Damage

A Double Feature Fusion Network with Progressive Learning for Sharper Inpainting

Dunhuang Mural Line Drawing Based on Multi-scale Feature Fusion and Sharp Edge Learning

ARIN: Adaptive Resampling and Instance Normalization for Robust Blind Inpainting of Dunhuang Cave Paintings

Ancient mural inpainting via structure information guided two-branch model

Digital inpainting of mural images based on DC-CycleGAN

Dunhuang murals contour generation network based on convolution and self-attention fusion

Inpainting of Dunhuang Murals by Sparsely Modeling the Texture Similarity and Structure Continuity