Abstract:Background: Hyperspectral imaging techniques have emerged as powerful tools for non-invasive investigation of artworks. This paper employs either reflectance imaging spectroscopy (RIS) or macroscopic X-ray fluorescence (MA-XRF) imaging in combination with macroscopic X-ray powder diffraction (MA-XRPD) for state-of-the-art chemical imaging of painted cultural heritage artefacts. While RIS can provide molecular information and MA-XRF can offer elemental distribution maps of paintings of high lateral resolution, the unique advantage of MA-XRPD lies in its ability to visualize the distributions of specific pigments and estimate in a quantitative manner the relative concentrations of the crystalline phases at the surface of artworks. However, MA-XRPD is more time-consuming and offers a lower lateral resolution than RIS and MA-XRF. Results: This study introduces a machine learning (ML) approach to obtain the distribution of specific compounds on the surface of artworks with a resolution that is comparable to that of RIS and MA-XRF data but with the compound specificity of MA-XRPD. The general aim is to expedite non-destructive artwork imaging analysis by fusing data from different imaging modalities via machine learning models. The effect of preprocessing techniques to enhance the predictive accuracy of the models is explored. The paper demonstrates the method's efficacy on a 16th-century illuminated manuscript, showcasing the feasibility of predicting compound-specific distribution maps. Three evaluation methods-visual examination of the predicted distribution, root mean square errors (RMSE), and feature permutation importance (FPI)-are employed to assess model performance. Fusing MA-XRF with MA-XRPD led to the best RMSE scores overall. However, fusing the RIS and MA-XRPD data blocks also yield very satisfactory and easily interpretable high-resolution compound maps. Significance: While MA-XRPD allows for highly specific imaging of artworks, its time-consuming nature and limited resolution presents a bottleneck during non-invasive imaging of painted works of art. By integrating data from more time-efficient hyperspectral techniques such as MA-XRF and RIS, and employing machine learning, we expedite the process without compromising accuracy. The fusion process can also denoise the distribution maps, improving their readability for heritage professionals and art historical scholars.

Machine learning regression algorithms for generating chemical element maps from X-ray fluorescence data of paintings

When de Prony Met Leonardo: An Automatic Algorithm for Chemical Element Extraction From Macro X-Ray Fluorescence Data

Deep learning for enhanced spectral analysis of MA-XRF datasets of paintings

Super-Resolution for Macro X-Ray Fluorescence Data Collected from Old Master Paintings

A Fast Automatic Method for Deconvoluting Macro X-Ray Fluorescence Data Collected from Easel Paintings

Revealing Hidden Drawings in Leonardo's 'the Virgin of the Rocks' from Macro X-Ray Fluorescence Scanning Data Through Element Line Localisation.

Can deep learning assist automatic identification of layered pigments from XRF data?

High-resolution compound-specific mapping in works of art via data fusion of MA-XRPD with hyperspectral data (part 1: Method evaluation)

Denoising Fast X-Ray Fluorescence Raster Scans of Paintings

Adversarial Deep-Unfolding Network for MA-XRF Super-Resolution on Old Master Paintings Using Minimal Training Data

Prediction of Heavy Metal Concentrations in Contaminated Sites from Portable X-ray Fluorescence Spectrometer Data Using Machine Learning

A Comparative Study of the Method to Rapid Identification of the Mural Pigments by Combining LIBS-Based Dataset and Machine Learning Methods

Towards virtual painting recolouring using Vision Transformer on X-Ray Fluorescence datacubes

A Learning Based Approach to Separate Mixed X-Ray Images Associated with Artwork with Concealed Designs

Predicting element concentrations by machine learning models in neutron activation analysis

Artifact identification in X‐ray diffraction data using machine learning methods

Machine Learning Automated Analysis of Enormous Synchrotron X-ray Diffraction Datasets

Machine Learning in X-ray Scattering for Materials Discovery and Characterization

Artifact Identification in X-ray Diffraction Data using Machine Learning Methods

Machine Learning-Assisted Analysis of Small Angle X-ray Scattering

Machine Learning Automated Approach for Enormous Synchrotron X-Ray Diffraction Data Interpretation