Abstract:Large datasets that were made publicly available to the research community over the last 20 years have been a key enabling factor for the advances in deep learning algorithms for NLP or computer vision. These datasets are generally pairs of aligned image / manually annotated metadata, where images are photographs of everyday life. Scholarly and historical content, on the other hand, treat subjects that are not necessarily popular to a general audience, they may not always contain a large number of data points, and new data may be difficult or impossible to collect. Some exceptions do exist, for instance, scientific or health data, but this is not the case for cultural heritage (CH). The poor performance of the best models in computer vision - when tested over artworks - coupled with the lack of extensively annotated datasets for CH, and the fact that artwork images depict objects and actions not captured by photographs, indicate that a CH-specific dataset would be highly valuable for this community. We propose DEArt, at this point primarily an object detection and pose classification dataset meant to be a reference for paintings between the XIIth and the XVIIIth centuries. It contains more than 15000 images, about 80% non-iconic, aligned with manual annotations for the bounding boxes identifying all instances of 69 classes as well as 12 possible poses for boxes identifying human-like objects. Of these, more than 50 classes are CH-specific and thus do not appear in other datasets; these reflect imaginary beings, symbolic entities and other categories related to art. Additionally, existing datasets do not include pose annotations. Our results show that object detectors for the cultural heritage domain can achieve a level of precision comparable to state-of-art models for generic images via transfer learning.

ARTDET: Machine learning software for automated detection of art deterioration in easel paintings

Knowledge Based Lacunas Detection And Segmentation For Ancient Paintings

A Priori-based Adaptive Repair Method for Mural Images

An Ultra Large Area Scanner for Ancient Painting and Calligraphy

DEArt: Dataset of European Art

ARTeFACT: Benchmarking Segmentation Models on Diverse Analogue Media Damage

No Annotations for Object Detection in Art through Stable Diffusion

Detection And Restoration of Cracked Digitized Paintings and Manuscripts Using Image Processing

Nearest Neighbor based Digital Restoration of Damaged Ancient Chinese Paintings

State-of-the-Art Fails in the Art of Damage Detection

Deep learning for enhanced spectral analysis of MA-XRF datasets of paintings

Automatic recognition of craquelure and paint loss on polychrome paintings of the Palace Museum using improved U-Net

Development of a New Non-Destructive Analysis Method in Cultural Heritage with Artificial Intelligence

Transforming Pixels into a Masterpiece: AI-Powered Art Restoration using a Novel Distributed Denoising CNN (DDCNN)

Progressive enhancement and restoration for mural images under low-light and defected conditions based on multi-receptive field strategy

A domain adaptive deep learning solution for scanpath prediction of paintings

Artifact Detection and Restoration in Histology Images with Stain-Style and Structural Preservation

Enhanced Wavelet Scattering Network for image inpainting detection

SAS: Painting Detection and Recognition Via Smart Art System with Mobile Devices.

A Method for Labeling Flaking Disease on Ancient Murals Based on Gradient Trainable Gabor and Channel Attention Mechanism

Deep learning algorithm in ancient relics image colour restoration technology