A painting authentication method based on multi-scale spatial-spectral feature fusion and convolutional neural network

Zimu Zeng,Pengchang Zhang,Shi Qiu,Siyuan Li,Xuebin Liu
DOI: https://doi.org/10.1016/j.compeleceng.2024.109315
IF: 4.152
2024-05-28
Computers & Electrical Engineering
Abstract:The scientific authentication of paintings holds significant importance within the realm of art collection. Employing convolutional neural networks for the classification of authentic and counterfeit painting images based on color images is a viable but suboptimal choice. This study investigates the potential for authenticating paintings by incorporating high-spectral images alongside high-resolution spatial images. High-resolution and high-spectral images of genuine and counterfeit paintings were acquired using a push-broom digital scanning system. The processing methods presented in this approach for the acquired images are: 1) The study utilized the circular local binary pattern (LBP) and principal component analysis (PCA) to extract surface texture and spectral data from Chinese character images in paintings, encompassing both spatial and spectral dimensions. 2) The technique utilizing non-subsampling Shearlet transform (NSST) and pulse-coupled neural network (PCNN) was employed to integrate the spatial and spectral characteristics of the images into a pseudo-color image, producing a dataset of feature data for genuine and counterfeit paintings. 3) The experiments aimed to achieve the authenticity of artworks using EfficientNet v2-s, the hyperparameters of which were fine-tuned accordingly. The experimental findings demonstrate that this approach attained a 90.8 % accuracy on the test dataset, representing a 3.5 % enhancement over the existing top-performing three-dimensional convolutional neural network (3D-CNN).
engineering, electrical & electronic,computer science, interdisciplinary applications, hardware & architecture
What problem does this paper attempt to address?