Abstract:The Dunhuang murals, notably the paintings on the interior walls of China's Dunhuang Grottoes, are considered international cultural treasure. The Dunhuang murals were ruined to varied degrees after a lengthy period of erosion. Deep learning networks were utilized to reconstruct broken parts of murals in order to better preserve their important historical and cultural values. Due to the presence of various damages, such as large peeling, mold and scratches, and multi-scale objects in the mural, a simple porting of existing working methods is suboptimal. In this paper, we propose a progressive Dunhuang murals inpainting (PDMI) based on recurrent feature reasoning network to progressively infer the pixel values of hole centers by a progressive approach, aiming to obtain visually reasonable and semantically consistent inpainted results. PDMI consists mainly of the FFC-based recurrent feature reasoning (RFR) module and Multi-scale Knowledge Consistent Attention (MKCA) module. The RFR module first fills in the feature value at the feature map's hole border, then utilizes the obtained feature value as a clue for further inference. The module steadily improved the limitation of hole centers, making the inpainted results more explicit; MKCA enables feature maps in RFR to handle richer background information from distant location information in a flexible manner while preventing misuse. After several round-robin inferences provide multiple feature maps, these feature maps are fused using an adaptive feature weighted fusion mechanism, then the fused feature maps decode back to RGB image. Experiments on a publicly available dataset and a self-made Dunhuang mural dataset reveal that the proposed method outperforms the comparison algorithm in both qualitative and quantitative aspects.

FSIS: Fast and Seamless Image Stitching of High-Resolution Dunhuang Murals

Image Stitching and Blending of Dunhuang Murals Based on Image Pyramid

Real-time browsing of high-precision frescos

Remote Sensing Image Stitch Using Modified Structure Deformation

Fast Parallel Compositon of Dunhuang Murals Based on Matrix Tearing

Large area interactive browsing for high resolution digitized dunhuang murals

Computer Aided Mural Restoration Based on GPU

Large Image Fast Compositing Based on Uniform Sample

Matrix Decomposition Graphics Processing Unit Solver for Poisson Image Editing

DunHuangStitch: Unsupervised Deep Image Stitching of Dunhuang Murals

A Priori-based Adaptive Repair Method for Mural Images

Virtual Completion of Facial Image in Ancient Murals

Image Inpainting for Digital Dunhuang Murals Using Partial Convolutions and Sliding Window Method

Inpainting Digital Dunhuang Murals with Structure-Guided Deep Network

Research on seamless image stitching based on fast marching method

Inpainting of Dunhuang Murals by Sparsely Modeling the Texture Similarity and Structure Continuity

Progressive Dunhuang murals inpainting based on recurrent feature reasoning network

SatellStitch: Satellite Imagery-Assisted UAV Image Seamless Stitching for Emergency Response without GCP and GNSS

Multi-stage Progressive Reasoning for Dunhuang Murals Inpainting

Elimination of Irregular Boundaries and Seams for UAV Image Stitching with a Diffusion Model

Parallel Multigrid Approach for Solving Poisson PDE in Gigapixel Image Editing