Abstract:Painted cultural relics hold significant historical value and are crucial in transmitting human culture. However, mold is a common issue for paper or silk-based relics, which not only affects their preservation and longevity but also conceals the texture, patterns, and color information, hindering cultural value and heritage. Currently, the virtual restoration of painting relics primarily involves filling in the RGB based on neighborhood information, which might cause color distortion and other problems. Another approach considers mold as noise and employs maximum noise separation for its removal; however, eliminating the mold components and implementing the inverse transformation often leads to more loss of information. To effectively acquire virtual restoration for mold removal from ancient paintings, the spectral characteristics of mold were analyzed. Based on the spectral features of mold and the cultural relic restoration philosophy of maintaining originality, a 3D CNN artifact restoration network was proposed. This network is capable of learning features in the near-infrared spectrum (NIR) and spatial dimensions to reconstruct the reflectance of visible spectrum, achieving the virtual restoration for mold removal of calligraphic and art relics. Using an ancient painting from the Qing Dynasty as a test subject, the proposed method was compared with the Inpainting, Criminisi, and inverse MNF transformation methods across three regions. Visual analysis, quantitative evaluation (the root mean squared error (RMSE), mean absolute percentage error (MAPE), mean absolute error (MEA), and a classification application were used to assess the restoration accuracy. The visual results and quantitative analyses demonstrated that the proposed 3D CNN method effectively removes or mitigates mold while restoring the artwork to its authentic color in various backgrounds. Furthermore, the color classification results indicated that the images restored with 3D CNN had the highest classification accuracy, with overall accuracies of 89.51%, 92.24%, and 93.63%, and Kappa coefficients of 0.88, 0.91, and 0.93, respectively. This research provides technological support for the digitalization and restoration of cultural artifacts, thereby contributing to the preservation and transmission of cultural heritage.

Quality assessment criteria and methods for 3D digital replica of historical printing woodblocks

Developing an Objective Visual Quality Evaluation Pipeline for 3D Woodblock Character

Alignment of 3D woodblock geometrical models and 2D orthographic projection image

Blurring and lens distortion free scanning for large area painting and calligraphy

Preserving Sculptural Heritage in the Era of Digital Transformation: Methods and Challenges of 3D Art Assessment

3D TECHNOLOGIES FOR INTANGIBLE CULTURAL HERITAGE PRESERVATION: CREATING 3D MODELS OF LACQUER ART THROUGH PHOTOGRAMMETRY

Image Layout and Schema Analysis of Chinese Traditional Woodblock Prints Based on Texture and Color Texture Characteristics in the Environment of Few Samples

On-line and in-line quality assessment across all scale levels of 3D concrete printing

Advanced Surface Color Quality Assessment in Paper-Based Full-Color 3D Printing

Nondestructive Evaluation of Harvested Cabbage Texture Quality Using 3D Scanning Technology

Watercolor Woodblock Printing with Image Analysis

3D Reproductions of Cultural Heritage Artifacts: Evaluation of Significance and Experience

3D printing: State of the art and future perspectives

Cultural Relics Restoration Technology in Virtual Reality: Application of 3D Modeling and Rendering Algorithms in Cultural Relics Digitization

Three-Dimensional Printing and 3D Scanning: Emerging Technologies Exhibiting High Potential in the Field of Cultural Heritage

Quality analysis on 3D building models reconstructed from airborne laser scanning data

Color Reproduction Accuracy Promotion of 3D-Printed Surfaces Based on Microscopic Image Analysis

Virtual Restoration of Ancient Mold-Damaged Painting Based on 3D Convolutional Neural Network for Hyperspectral Image

Real 3D Digital Method for Large-Scale Cultural Heritage Sites

Methodology for the Application of 3D Technologies for the Conservation and Recovery of Built Heritage Elements

A METHOD OF 3D MEASUREMENT AND RECONSTRUCTION FOR CULTURAL RELICS IN MUSEUMS