Abstract:The idea of reference guidance is introduced into mural restoration, trying to restore the original appearance of murals. The H‐ResNet‐HAB module activates more effective pixels of the mural. Connecting the layered embedding modules through the idea of residual connection improves the effect of mural restoration. In response to the inadequate utilization of prior information in current mural inpainting processes, leading to issues such as semantically unreliable inpaintings and the presence of artifacts in the inpainting area, a Dunhuang mural inpainting method based on reference guidance and multi‐scale feature fusion is proposed. First, the simulated broken mural, the mask image, and the reference mural are input into the model to complete the multi‐level embedding of patches and align the multi‐scale fine‐grained features of damaged murals and reference murals. Following the patch embedding module, a hybrid residual module is added based on hybrid attention to fully extract mural features. In addition, by continuing the residual concatenation of outputs of the hierarchical embedding module improves the ability of the model to represent deeper features, and improves the robustness and generalisation of the model. Second, the encoded features are fed into the decoder to generate decoded features. Finally, the convolutional tail is employed to propagate them and complete the mural painting. Experimental validation on the Dunhuang mural dataset demonstrates that, compared to other algorithms, this model exhibits higher evaluation metrics in the inpainting of extensively damaged murals and demonstrates overall robustness. In terms of visual effects, the results of this model in the inpainting process exhibit finer textures, richer semantic information, more coherent edge structures, and a closer resemblance to authentic murals.

Classification of Dunhuang Mural Image Based on Small-sample and Semi-supervised Learning

Aesthetic Visual Style Assessment on Dunhuang Murals

Knowledge Based Lacunas Detection And Segmentation For Ancient Paintings

Exploring the topic evolution of Dunhuang murals through image classification

Dual-Classifier Collaborative Method Based on Semi-Supervised Active Learning

Research on Dynasty Classification of Dunhuang Murals Based on Convolutional Neural Networks

DunHuangStitch: Unsupervised Deep Image Stitching of Dunhuang Murals

Semi-Supervised Dual Relation Learning for Multi-Label Classification

Ancient mural classification methods based on a multichannel separable network

Multi-Modal Curriculum Learning for Semi-Supervised Image Classification

Leveraging Semi-Supervised Learning to Enhance Data Mining for Image Classification under Limited Labeled Data

Dunhuang murals contour generation network based on convolution and self-attention fusion

Constructing a mobile visual search framework for Dunhuang murals based on fine-tuned CNN and ontology semantic distance

MixLab: An Informative Semi-supervised Method for Multi-label Classification

Dunhuang mural inpainting based on reference guidance and multi‐scale fusion

Image classification of hyperspectral remote sensing using semi-supervised learning algorithm

Remote Sensing Image Classification with Few Labeled Data Using Semisupervised Learning

Semi-Supervised Few-shot Image Classification Based on Subspace Learning

Dunhuang Mural Line Drawing Based on Multi-scale Feature Fusion and Sharp Edge Learning

Improving the crop classification performance by unlabeled remote sensing data

Cross-Level Multi-Instance Distillation for Self-Supervised Fine-Grained Visual Categorization