Abstract:The idea of reference guidance is introduced into mural restoration, trying to restore the original appearance of murals. The H‐ResNet‐HAB module activates more effective pixels of the mural. Connecting the layered embedding modules through the idea of residual connection improves the effect of mural restoration. In response to the inadequate utilization of prior information in current mural inpainting processes, leading to issues such as semantically unreliable inpaintings and the presence of artifacts in the inpainting area, a Dunhuang mural inpainting method based on reference guidance and multi‐scale feature fusion is proposed. First, the simulated broken mural, the mask image, and the reference mural are input into the model to complete the multi‐level embedding of patches and align the multi‐scale fine‐grained features of damaged murals and reference murals. Following the patch embedding module, a hybrid residual module is added based on hybrid attention to fully extract mural features. In addition, by continuing the residual concatenation of outputs of the hierarchical embedding module improves the ability of the model to represent deeper features, and improves the robustness and generalisation of the model. Second, the encoded features are fed into the decoder to generate decoded features. Finally, the convolutional tail is employed to propagate them and complete the mural painting. Experimental validation on the Dunhuang mural dataset demonstrates that, compared to other algorithms, this model exhibits higher evaluation metrics in the inpainting of extensively damaged murals and demonstrates overall robustness. In terms of visual effects, the results of this model in the inpainting process exhibit finer textures, richer semantic information, more coherent edge structures, and a closer resemblance to authentic murals.

Wavelet-Based Dual-Stream Network for Inpainting of Dunhuang Murals

FSIS: Fast and Seamless Image Stitching of High-Resolution Dunhuang Murals

Virtual Dunhuang Mural Restoration System in Collaborative Network Environment

Using hybrid knowledge engineering and image processing in color virtual restoration of ancient murals

A Priori-based Adaptive Repair Method for Mural Images

Color Restoration Techniques For Faded Mural Of Mogao Grotto

Computer Aided Protection and Restoration of Dunhuang Mural

Inpainting Digital Dunhuang Murals with Structure-Guided Deep Network

Virtual Completion of Facial Image in Ancient Murals

Image Inpainting for Digital Dunhuang Murals Using Partial Convolutions and Sliding Window Method

Image Processing For Virtual Recovery Of Murals

Multi-stage Progressive Reasoning for Dunhuang Murals Inpainting

Progressive Dunhuang murals inpainting based on recurrent feature reasoning network

Dunhuang murals image restoration method based on generative adversarial network

Digital inpainting of mural images based on DC-CycleGAN

Dunhuang mural inpainting based on reference guidance and multi‐scale fusion

Inpainting of Dunhuang Murals by Sparsely Modeling the Texture Similarity and Structure Continuity

Two-stage mural image restoration using an edge-constrained attention mechanism

A Double Feature Fusion Network with Progressive Learning for Sharper Inpainting

Line-drawing enhanced interactive mural restoration for dunhuang

Restoration of Dunhuang Murals on Large-scale pretraining