Abstract:Mural is an important component of culture and art of Dunhuang in China. Unfortunately, these murals had been ruined or are being ruined by some diseases such as cracking, hollowing, falling off, mildew, dirt, and so on. Existing image restoration algorithms have problems such as incomplete repair and disharmonious texture during large-area repair, so the effect of mural image disease area repair is poor. Due to lack of a standard mural datasets, Dunhuang mural datasets are created in the paper. Meanwhile, our network architecture SeparaFill is proposed which connects two generators based on U-Net. Based on the characteristics of the painting, the contour line pixel area of the mural image is innovatively separated from the content pixel area. Firstly, the contour restoration generator network with skip connect and hierarchical residual blocks is employed to repair contour lines. Then, the color mural image is repaired by the content completion network with guide of the repaired contour. Full resolution branches and generator branches of the U type are exploited in content completion generators. Convolution layers of different kernel sizes are fused to improve the reusability of the underlying features. Finally, global and local discriminant networks are applied to determine whether the repaired mural image is authentic in terms of both the modified and unmodified areas. The proposed SeparaFill shows good performance in restoring the line structure of the damaged mural images and retaining the contour information of the mural images. Compared with existing restoration algorithms in mural real damage repair experiment, our algorithm increases the peak signal-to-noise ratio (PSNR) by an average of 1.1–4.3 dB and the structural similarity (SSIM) values were slightly improved. Experimental results reveal the good performance of the proposed model, which can contribute to digital restorations of ancient murals.

MuralRescue: Advancing Blind Mural Restoration Via SAM-Adapter Enhanced Damage Segmentation and Integrated Restoration Techniques

A Priori-based Adaptive Repair Method for Mural Images

Using hybrid knowledge engineering and image processing in color virtual restoration of ancient murals

Color Restoration Techniques For Faded Mural Of Mogao Grotto

Image Processing For Virtual Recovery Of Murals

Virtual Completion of Facial Image in Ancient Murals

Knowledge Based Lacunas Detection And Segmentation For Ancient Paintings

Computer Aided Protection and Restoration of Dunhuang Mural

Virtual Dunhuang Mural Restoration System in Collaborative Network Environment

Computer Aided Mural Restoration Based on GPU

Dunhuang mural inpainting based on reference guidance and multi‐scale fusion

Line Drawing Guided Progressive Inpainting of Mural Damage

Two-stage mural image restoration using an edge-constrained attention mechanism

Progressive Dunhuang Murals Inpainting Based on Attention Mechanism

Dunhuang murals image restoration method based on generative adversarial network

Progressive enhancement and restoration for mural images under low-light and defected conditions based on multi-receptive field strategy

Bring Ancient Murals Back to Life.

SeparaFill: Two generators connected mural image restoration based on generative adversarial network with skip connect

Multi-stage Progressive Reasoning for Dunhuang Murals Inpainting

Line-drawing enhanced interactive mural restoration for dunhuang

MuralDiff: Diffusion for Ancient Murals Restoration on Large-Scale Pre-Training