Abstract:Background: Hyperspectral imaging techniques have emerged as powerful tools for non-invasive investigation of artworks. This paper employs either reflectance imaging spectroscopy (RIS) or macroscopic X-ray fluorescence (MA-XRF) imaging in combination with macroscopic X-ray powder diffraction (MA-XRPD) for state-of-the-art chemical imaging of painted cultural heritage artefacts. While RIS can provide molecular information and MA-XRF can offer elemental distribution maps of paintings of high lateral resolution, the unique advantage of MA-XRPD lies in its ability to visualize the distributions of specific pigments and estimate in a quantitative manner the relative concentrations of the crystalline phases at the surface of artworks. However, MA-XRPD is more time-consuming and offers a lower lateral resolution than RIS and MA-XRF. Results: This study introduces a machine learning (ML) approach to obtain the distribution of specific compounds on the surface of artworks with a resolution that is comparable to that of RIS and MA-XRF data but with the compound specificity of MA-XRPD. The general aim is to expedite non-destructive artwork imaging analysis by fusing data from different imaging modalities via machine learning models. The effect of preprocessing techniques to enhance the predictive accuracy of the models is explored. The paper demonstrates the method's efficacy on a 16th-century illuminated manuscript, showcasing the feasibility of predicting compound-specific distribution maps. Three evaluation methods-visual examination of the predicted distribution, root mean square errors (RMSE), and feature permutation importance (FPI)-are employed to assess model performance. Fusing MA-XRF with MA-XRPD led to the best RMSE scores overall. However, fusing the RIS and MA-XRPD data blocks also yield very satisfactory and easily interpretable high-resolution compound maps. Significance: While MA-XRPD allows for highly specific imaging of artworks, its time-consuming nature and limited resolution presents a bottleneck during non-invasive imaging of painted works of art. By integrating data from more time-efficient hyperspectral techniques such as MA-XRF and RIS, and employing machine learning, we expedite the process without compromising accuracy. The fusion process can also denoise the distribution maps, improving their readability for heritage professionals and art historical scholars.

When de Prony Met Leonardo: An Automatic Algorithm for Chemical Element Extraction From Macro X-Ray Fluorescence Data

Revealing Hidden Drawings in Leonardo's 'the Virgin of the Rocks' from Macro X-Ray Fluorescence Scanning Data Through Element Line Localisation.

A Fast Automatic Method for Deconvoluting Macro X-Ray Fluorescence Data Collected from Easel Paintings

Deep learning for enhanced spectral analysis of MA-XRF datasets of paintings

Super-Resolution for Macro X-Ray Fluorescence Data Collected from Old Master Paintings

High-resolution compound-specific mapping in works of art via data fusion of MA-XRPD with hyperspectral data (part 1: Method evaluation)

Denoising Fast X-Ray Fluorescence Raster Scans of Paintings

Machine learning regression algorithms for generating chemical element maps from X-ray fluorescence data of paintings

Can deep learning assist automatic identification of layered pigments from XRF data?

Adversarial Deep-Unfolding Network for MA-XRF Super-Resolution on Old Master Paintings Using Minimal Training Data

Application of Macro X-ray Fluorescence Fast Mapping to Thickness Estimation of Layered Pigments

Leveraging Machine Learning for Advanced Nanoscale X-ray Analysis: Unmixing Multicomponent Signals and Enhancing Chemical Quantification

Combined macro X-ray fluorescence (MA-XRF) and pulse phase thermography (PPT) imaging for the technical study of panel paintings

Imaging secondary reaction products at the surface of Vermeer’s Girl with the Pearl Earring by means of macroscopic X-ray powder diffraction scanning

Differential X-Ray Attenuation in MA-XRF Analysis for a Non-invasive Determination of Gilding Thickness

High-Resolution Non-Invasive X-ray Diffraction Analysis of Artists Paints

Numerical and Monte Carlo Simulation on X-ray Fluorescence Computed Tomography with Self-Absorption Correction

Fingerprint Analysis of X-Ray Absorption Spectra of Catalysts: From Linear Combination Fit to Machine-Learning Trained on Multielement Experimental Library

Integration of multispectral visible-infrared imaging and pointwise X-ray fluorescence data for the analysis of a large canvas painting by Carpaccio

Towards virtual painting recolouring using Vision Transformer on X-Ray Fluorescence datacubes