Abstract:X-ray fluorescence spectroscopy (XRF) plays an important role for elemental analysis in a wide range of scientific fields, especially in cultural heritage. XRF imaging, which uses a raster scan to acquire spectra pixel-wise across artworks, provides the opportunity for spatial analysis of pigment distributions based on their elemental composition. However, conventional XRF-based pigment identification relies on time-consuming elemental mapping facilitated by the interpretation of measured spectra by experts. To reduce the reliance on manual work, recent studies have applied machine learning techniques to cluster similar XRF spectra in data analysis and to identify the most likely pigments. Nevertheless, it is still challenging to implement automatic pigment identification strategies to directly tackle the complex structure of real paintings, e.g. pigment mixtures and layered pigments. In addition, pigment identification based on XRF on a pixel-by-pixel basis remains an obstacle due to the high noise level. Therefore, we developed a deep-learning based pigment identification framework to fully automate the process. In particular, this method offers high sensitivity to the underlying pigments and to the pigments present in low concentrations, therefore enabling robust mapping of pigments based on single-pixel XRF spectra. As case studies, we applied our framework to lab-prepared mock-up paintings and two 19th-century paintings: Paul Gauguin's Poèmes Barbares (1896) that contains layered pigments with an underlying painting, and Paul Cezanne's The Bathers (1899–1904). The pigment identification results demonstrated that our model achieved comparable results to the analysis by elemental mapping, suggesting the generalizability and stability of our model.

Mixed X-Ray Image Separation for Artworks with Concealed Designs

Image Separation With Side Information: A Connected Auto-Encoders Based Approach

Multi-Modal Dictionary Learning for Image Separation With Application in Art Investigation

Knowledge Based Lacunas Detection And Segmentation For Ancient Paintings

Deep learning for enhanced spectral analysis of MA-XRF datasets of paintings

Interactive Separation Network for Image Inpainting

Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm

Can deep learning assist automatic identification of layered pigments from XRF data?

Adversarial Deep-Unfolding Network for MA-XRF Super-Resolution on Old Master Paintings Using Minimal Training Data

Crossing Points Detection in Plain Weave for Old Paintings with Deep Learning

Author Recognition of Fine-Art Paintings

Image Inpainting Anti-Forensics Network Via Attention-Guided Hierarchical Reconstruction

Interactive Defect Segmentation in X-Ray Images Based on Deep Learning

Instance Separation Emerges from Inpainting

Sketch Layer Separation in Multi-Spectral Historical Document Images

Towards Reliable Image Outpainting: Learning Structure-Aware Multimodal Fusion with Depth Guidance

SafePaint: Anti-forensic Image Inpainting with Domain Adaptation

Reflection Scene Separation From A Single Image

When de Prony Met Leonardo: An Automatic Algorithm for Chemical Element Extraction From Macro X-Ray Fluorescence Data

Art2Real: Unfolding the Reality of Artworks via Semantically-Aware Image-to-Image Translation

Generative Adversarial Network Using Multi-modal Guidance for Ultrasound Images Inpainting.