An image processing of a Raphael's portrait of Leonardo

Amelia Carolina Sparavigna

DOI: https://doi.org/10.48550/arXiv.1111.6030

2011-11-25

Computer Vision and Pattern Recognition

Abstract:In one of his paintings, the School of Athens, Raphael is depicting Leonardo da Vinci as the philosopher Plato. Some image processing tools can help us in comparing this portrait with two Leonardo's portraits, considered as self-portraits.

What problem does this paper attempt to address?

EasyPainter: Customizing Your Own Paintings

Yuqi Zhang,Qian Zheng,Gang Pan

DOI: https://doi.org/10.1007/978-3-031-20503-3_55

2022-01-01

Abstract:With the advance in deep learning techniques, increasing attention has been paid to studying the creation capacity of artificial intelligence (AI) models. AI-based painting image generation not only streamlines tedious tasks of professional users but also enlightens a broad range of casual users for artistic creation. This paper focuses on customizing painting images with limited inputs, i.e., a reference painting image as the exemplar and a conditional input that users could easily specify to reflect their ideas. We show the challenges of directly applying existing solutions to the problem of painting customizing and provide a solution to address them. We also develop the EasyPainter, a user-friendly interface system to better understand AI's creative and exploratory potential in customizing painting images. Our demo video is available here.
Feature-Based Automatic Portrait Generation System

Yin Zhang,Lu Gao,Sanyuan Zhang

DOI: https://doi.org/10.1109/CSIE.2009.683

2009-01-01

Abstract:Creating a portrait in the style of a particular artistic tradition or a particular artist is a difficult and also an interesting problem in Non-photorealistic Rendering. This paper develops an automatic feature-based portrait generation system, which can transform the input facial photo into a portrait in the style of a given artist’s finished work. First, we propose a new face model, which contains 64 feature points. Second, we extract the facial features using rules and geometric information. Based on the statistics, we divide the face into several small regions, each of which only contains one feature. The fixed-direction open active contour models are employed to extract corresponding feature points in each region. Finally, the system generates a portrait by feature-based morphing, which uses the artist’s work as the source image. The results show that the system is capable of producing portraits in different styles effectively.
The Digital Restoration of Da Vinci's Sketches

Amelia Sparavigna

DOI: https://doi.org/10.48550/arXiv.0903.1448

2009-03-09

Abstract:A sketch, found in one of Leonardo da Vinci's notebooks and covered by the written notes of this genius, has been recently restored. The restoration reveals a possible self-portrait of the artist, drawn when he was young. Here, we discuss the discovery of this self-portrait and the procedure used for restoration. Actually, this is a restoration performed on the digital image of the sketch, a procedure that can easily extended and applied to ancient documents for studies of art and palaeography.

Computer Vision and Pattern Recognition,Graphics
Toward Unbiased High-Quality Portraits through Latent-Space Evaluation

Doaa Almhaithawi,Alessandro Bellini,Tania Cerquitelli

DOI: https://doi.org/10.3390/jimaging10070157

2024-06-28

Abstract:Images, texts, voices, and signals can be synthesized by latent spaces in a multidimensional vector, which can be explored without the hurdles of noise or other interfering factors. In this paper, we present a practical use case that demonstrates the power of latent space in exploring complex realities such as image space. We focus on DaVinciFace, an AI-based system that explores the StyleGAN2 space to create a high-quality portrait for anyone in the style of the Renaissance genius Leonardo da Vinci. The user enters one of their portraits and receives the corresponding Da Vinci-style portrait as an output. Since most of Da Vinci's artworks depict young and beautiful women (e.g., "La Belle Ferroniere", "Beatrice de' Benci"), we investigate the ability of DaVinciFace to account for other social categorizations, including gender, race, and age. The experimental results evaluate the effectiveness of our methodology on 1158 portraits acting on the vector representations of the latent space to produce high-quality portraits that retain the facial features of the subject's social categories, and conclude that sparser vectors have a greater effect on these features. To objectively evaluate and quantify our results, we solicited human feedback via a crowd-sourcing campaign. Analysis of the human feedback showed a high tolerance for the loss of important identity features in the resulting portraits when the Da Vinci style is more pronounced, with some exceptions, including Africanized individuals.
Computational identification of significant actors in paintings through symbols and attributes

David G.Stork,Anthony Bourached,George H.Cann,Ryan-Rhys Griffiths

DOI: https://doi.org/10.48550/arXiv.2102.02732

2021-02-05

Abstract:The automatic analysis of fine art paintings presents a number of novel technical challenges to artificial intelligence, computer vision, machine learning, and knowledge representation quite distinct from those arising in the analysis of traditional photographs. The most important difference is that many realist paintings depict stories or episodes in order to convey a lesson, moral, or meaning. One early step in automatic interpretation and extraction of meaning in artworks is the identifications of figures (actors). In Christian art, specifically, one must identify the actors in order to identify the Biblical episode or story depicted, an important step in understanding the artwork. We designed an automatic system based on deep convolutional neural networks and simple knowledge database to identify saints throughout six centuries of Christian art based in large part upon saints symbols or attributes. Our work represents initial steps in the broad task of automatic semantic interpretation of messages and meaning in fine art.

Computer Vision and Pattern Recognition
Portrait painting using active templates.

Mingtian Zhao,Song Chun Zhu

DOI: https://doi.org/10.1145/2024676.2024696

2011-01-01

Abstract:ABSTRACTPortraiture plays a substantial role in traditional painting, yet it has not been studied in depth in painterly rendering research. The difficulty in rendering human portraits is due to our acute visual perception to the structure of human face. To achieve satisfactory results, a portrait rendering algorithm should account for facial structure. In this paper, we present an example-based method to render portrait paintings from photographs, by transferring brush strokes from previously painted portrait templates by artists. These strokes carry rich information about not only the facial structure but also how artists depict the structure with large and decisive brush strokes and vibrant colors. With a dictionary of portrait painting templates for different types of faces, we show that this method can produce satisfactory results.
Artificial intelligence's interpretation of the neuroanatomical aspect of Peter Paul Rubens's copy of "The Battle of Anghiari" by Leonardo da Vinci

Grigol Keshelava

DOI: https://doi.org/10.1177/03010066231165915

IF: 1.695

Perception

Abstract:We tested to see how Ruben's copy of "The Battle of Anghiari" by Leonardo da Vinci would be interpreted by AI in a neuroanatomical aspect. We used WOMBO Dream, an artificial intelligence (AI)-based algorithm that creates images based on words and figures. The keyword we provided for the algorithm was "brain" and the reference image was Ruben's drawing. AI interpreted the whole drawing as a representation of the brain. The image generated by the algorithm was similar to our interpretation of the same painting.
Empathy and the art of Leonardo da Vinci

Samira Schultz Mansur,Javier DeFelipe

DOI: https://doi.org/10.3389/fpsyg.2023.1260814

IF: 3.8

2024-03-09

Frontiers in Psychology

Abstract:Knowledge about empathy is part of the study of artistic expressions, among which stand out works of personalities such as the Renaissance polymath Leonardo da Vinci, who was concerned with the connection between science and art during his creative research full of imagination and sensitivity to nature and human anatomy. The word empathy emerged among critics of German art as the term einfühlung , which was used within the aesthetic bias by philosophers and art historians. It emphasized the idea that a viewer perceiving an object could establish a link between it and themselves, projecting the object 'into themselves'. That is, the artwork could be experienced by the observer as if the viewer belonged predominantly to the object, in such a way that its characteristics could be actually felt through the expression of emotions, feelings and thoughts. This analysis of art appreciation required a great deal of knowledge and contemplation of nature, as understood by the German Romanticists, who had enormous admiration for da Vinci and his universal and systematic mind—a mind which reacted against formalisms, building his intellectual and sensory systems based on both his observation of nature and his own criteria. In particular, the art of painting for Leonardo was a way to demonstrate a mental discourse, just as the most important aspect of human portraits is to represent—in gestures and facial expressions—the states of mind and emotions. These are facts that German Romanticists tried to explain as the relationship between empathy and a work of art. The present manuscript aims to describe empathy from an artistic view, considering the roots of this word in German Romanticism; to comment about Leonardo da Vinci and the expression of art in the Renaissance; and, finally, to discuss the expression of his art in relation to empathy.

psychology, multidisciplinary
Cultural heritage digital twin: modeling and representing the visual narrative in Leonardo Da Vinci's Mona Lisa

Alessia Amelio,Gian Piero Zarri

DOI: https://doi.org/10.1007/s00521-024-10010-x

2024-06-08

Neural Computing and Applications

Abstract:In this paper, Artificial Intelligence/Knowledge Representation methods are used for the digital modeling of cultural heritage elements. Accordingly, the new concept of digital cultural heritage twin is presented as composed of a physical component and an immaterial component of the cultural entity. The former concerns the physical aspects, i.e. style, name of the artist, execution time, dimension, etc. The latter represents the emotional and intangible aspects transmitted by the entity, i.e. emotions, thoughts, opinions. In order to digitally model the physical and immaterial components of the twin, the Narrative Knowledge Representation Language has been formally introduced and described. It is particularly suitable for representing the immaterial aspects of the cultural entity, as it is capable of modeling in a simple but rigorous and efficient way complex situations and events, behaviours, attitudes, etc. As an experiment, NKRL has been adopted for representing some of the most relevant intangible items of the visual narrative underlying the hidden painting that lies beneath the Mona Lisa (La Gioconda) image painted by Leonardo Da Vinci on the same poplar panel. Real-time application of the resulting knowledge base opens up novel possibilities for the development of virtual objects, chatbots and expert systems, as well as the definition of semantic search platforms related to cultural heritage.

computer science, artificial intelligence
How does the Italian High Renaissance Artist Raphael Sanzio connect the past, present, and future of the art community?

Tianyi Xie

DOI: https://doi.org/10.47611/jsrhs.v11i3.3202

2022-08-31

Journal of Student Research

Abstract:The artist Raphael Sanzio is one of the most renowned artists in the history of art, praised of his ideal of perfection, beauty, and harmony that prompted the Italian High Renaissance to its very peak. Conventionally, investigation on Raphael’s influence as a master would center around his major art creations during the High Renaissance. This essay would also explore Raphael’s main achievements in the artistic sphere (including education, techniques, compositions, and aesthetic theories) and his social life during the High Renaissance as his present but would at the same time discuss the connection of his present to the past and future of the art community. In terms of the past during the Early Renaissance, this essay would elaborate on how past events of commercialization of economy triggers the dignified status of artists, compared to the status of craftsmen during the Middle Ages. Moreover, in terms of the future, this essay would depict Raphael’s influence and contribution to artistic movements surrounding the Academia and the modernists during the Early Modern period.
Artistic Painting By Reference Images

Weidong Geng

DOI: https://doi.org/10.1007/978-3-642-04891-3_4

2010-01-01

Abstract: The artistic painting by reference images is to convert the source input images into the corresponding paintings with the desired artistic effects. From the point of view of research methodology, the existing work can be summarized into three categories: (1) The reference images are taken as source images, and then the artistic processing techniques (e.g., half-tone, heuristic image processing rules, empirical stroke-generation techniques, etc.) are employed to transform the reference images into the resulting painting in terms of the user specified rendering styles, and other parameters, to control the visual effect. (2) The reference images are used to directly specify the desired visual effects or artistic features, which are extracted from reference images and then matched to that in the input source images. A computational model of feature association between input and reference images is then built, which will accordingly synthesize the resulting painting via optimization techniques. (3) A set of reference images is used to implicitly specify the association relationship of visual effect between source and target images. Then the analogy-based learning techniques are employed to automatically convert the newly input images into the resulting painting with the desired visual effect consistent with the relationship among the reference images.
Everyone Can Be Picasso? A Computational Framework into the Myth of Human versus AI Painting

Yilin Ye,Rong Huang,Kang Zhang,Wei Zeng

DOI: https://doi.org/10.48550/arXiv.2304.07999

2024-02-22

Abstract:The recent advances of AI technology, particularly in AI-Generated Content (AIGC), have enabled everyone to easily generate beautiful paintings with simple text description. With the stunning quality of AI paintings, it is widely questioned whether there still exists difference between human and AI paintings and whether human artists will be replaced by AI. To answer these questions, we develop a computational framework combining neural latent space and aesthetics features with visual analytics to investigate the difference between human and AI paintings. First, with categorical comparison of human and AI painting collections, we find that AI artworks show distributional difference from human artworks in both latent space and some aesthetic features like strokes and sharpness, while in other aesthetic features like color and composition there is less difference. Second, with individual artist analysis of Picasso, we show human artists' strength in evolving new styles compared to AI. Our findings provide concrete evidence for the existing discrepancies between human and AI paintings and further suggest improvements of AI art with more consideration of aesthetics and human artists' involvement.

Human-Computer Interaction,Artificial Intelligence,Computer Vision and Pattern Recognition
A Data Set and a Convolutional Model for Iconography Classification in Paintings

Federico Milani,Piero Fraternali

DOI: https://doi.org/10.1145/3458885

2021-07-26

Abstract:Iconography in art is the discipline that studies the visual content of artworks to determine their motifs and themes andto characterize the way these are represented. It is a subject of active research for a variety of purposes, including the interpretation of meaning, the investigation of the origin and diffusion in time and space of representations, and the study of influences across artists and art works. With the proliferation of digital archives of art images, the possibility arises of applying Computer Vision techniques to the analysis of art images at an unprecedented scale, which may support iconography research and education. In this paper we introduce a novel paintings data set for iconography classification and present the quantitativeand qualitative results of applying a Convolutional Neural Network (CNN) classifier to the recognition of the iconography of artworks. The proposed classifier achieves good performances (71.17% Precision, 70.89% Recall, 70.25% F1-Score and 72.73% Average Precision) in the task of identifying saints in Christian religious paintings, a task made difficult by the presence of classes with very similar visual features. Qualitative analysis of the results shows that the CNN focuses on the traditional iconic motifs that characterize the representation of each saint and exploits such hints to attain correct identification. The ultimate goal of our work is to enable the automatic extraction, decomposition, and comparison of iconography elements to support iconographic studies and automatic art work annotation.

Computer Vision and Pattern Recognition,Machine Learning
Learning Portrait Style Representations

Sadat Shaik,Bernadette Bucher,Nephele Agrafiotis,Stephen Phillips,Kostas Daniilidis,William Schmenner

DOI: https://doi.org/10.48550/arXiv.2012.04153

2020-12-08

Computer Vision and Pattern Recognition

Abstract:Style analysis of artwork in computer vision predominantly focuses on achieving results in target image generation through optimizing understanding of low level style characteristics such as brush strokes. However, fundamentally different techniques are required to computationally understand and control qualities of art which incorporate higher level style characteristics. We study style representations learned by neural network architectures incorporating these higher level characteristics. We find variation in learned style features from incorporating triplets annotated by art historians as supervision for style similarity. Networks leveraging statistical priors or pretrained on photo collections such as ImageNet can also derive useful visual representations of artwork. We align the impact of these expert human knowledge, statistical, and photo realism priors on style representations with art historical research and use these representations to perform zero-shot classification of artists. To facilitate this work, we also present the first large-scale dataset of portraits prepared for computational analysis.
A software for aging faces applied to ancient marble busts

Amelia Carolina Sparavigna

DOI: https://doi.org/10.48550/arXiv.1304.1022

2013-04-03

Computer Vision and Pattern Recognition

Abstract:The study and development of software able to show the effect of aging of faces is one of the tasks of face recognition technologies. Some software solutions are used for investigations, some others to show the effects of drugs on healthy appearance, however some other applications can be proposed for the analysis of visual arts. Here we use a freely available software, which is providing interesting results, for the comparison of ancient marble busts. An analysis of Augustus busts is proposed.
Color-Coded Symbology and New Computer Vision Tool to Predict the Historical Color Pallets of the Renaissance Oil Artworks

Artyom M. Grigoryan,Sos S. Agaian

DOI: https://doi.org/10.48550/arXiv.2103.00238

2021-02-27

Abstract:In this paper, we discuss possible color palletes, prediction and analysis of originality of the colors that Artists used on the Renaissance oil paintings. This framework goal is to help to use the color symbology and image enhancement tools, to predict the historical color palletes of the Renaissance oil artworks. This work is only the start of a development to explore the possibilities of prediction of color palletes of the Renaissance oil artworks. We believe that framework might be very useful in the prediction of color palletes of the Renaissance oil artworks and other artworks. The images in number 105 have been taken from the paintings of three well-known artists, Rafael, Leonardo Da Vinci, and Rembrandt that are available in the Olga's Gallery. Images are processed in the frequency domain to enhance a quality of images and ratios of primary colors are calculated and analyzed by using new measurements of color-ratios.

Computer Vision and Pattern Recognition
Automatic Portrait Oil Painter: Joint Domain Stylization for Portrait Images

Saboya Yang,Shuai Yang,Wenhan Yang,Jiaying Liu

DOI: https://doi.org/10.1007/s11042-017-5190-z

IF: 2.577

2017-01-01

Multimedia Tools and Applications

Abstract:Everyone has the dream of being in the center of famous art paintings, admired by numerous future generations. However, the dream came true at a huge cost of the painter’s commission in old days. In our paper, another practical choice is provided for everyone to achieve that dream – an automatic portrait oil painter transferring some artistic styles from one single reference painting. To address this issue, we propose a joint-domain image stylization approach, particularly for portrait oil paintings. From the view of artistic appreciation, we analyze an amount of oil painting art works and summarize three critical factors to depict the figure, i.e. color, structure and texture. Based on this point, we separate and represent an artistic work into these three domains. Then, considering their intrinsic properties and following an art creation route, we propose the corresponding approaches to jointly model and transfer the features in these domains. First, a swatch-based color adjustment is proposed to recolor the tone of the input image based on semantic regions corresponding to the references. Second, the main structures of the input image is maintained by sparse reconstruction. Third, a coarse-to-fine texture synthesis is used to enhance the detail oil painting patterns. Extensive experimental results demonstrate that the proposed method achieves desirable results compared with state-of-the-art methods in not only transferring the styles from references but also keeping consistent contents with the given portrait.
Leveraging Computer Vision Application in Visual Arts: A Case Study on the Use of Residual Neural Network to Classify and Analyze Baroque Paintings

Daniel Kvak

DOI: https://doi.org/10.48550/arXiv.2210.15300

2022-10-27

Abstract:With the increasing availability of large digitized fine art collections, automated analysis and classification of paintings is becoming an interesting area of research. However, due to domain specificity, implicit subjectivity, and pervasive nuances that vaguely separate art movements, analyzing art using machine learning techniques poses significant challenges. Residual networks, or variants thereof, are one the most popular tools for image classification tasks, which can extract relevant features for well-defined classes. In this case study, we focus on the classification of a selected painting 'Portrait of the Painter Charles Bruni' by Johann Kupetzky and the analysis of the performance of the proposed classifier. We show that the features extracted during residual network training can be useful for image retrieval within search systems in online art collections.

Multimedia,Computer Vision and Pattern Recognition
The psychology of Mona Lisa's smile

Alessandro Soranzo

DOI: https://doi.org/10.1038/s41598-024-59782-1

IF: 4.6

2024-05-30

Scientific Reports

Abstract:Mona Lisa's ambiguous expression, oscillating between melancholy and contentment, has captivated viewers for centuries, prompting diverse explanations. This article proposes a novel interpretation grounded in the psychological theory of perceptual organisation. Central to the investigation is the "Ambiguity-Nuance", a subtly shaded, blended region framing the upper part of the lips, hypothesised to influence perceived expression due to perceptual organization. Through carefully crafted artwork and systematic manipulations of Mona Lisa reproductions, experiments reveal how alterations in the perceptual relationships of the Ambiguity-Nuance yield significant shifts in perceived expression, explaining why Mona Lisa's appearance changes and under which conditions she looks content versus melancholic based on perceptual organization. These findings underscore the pivotal role of psychological principles in shaping ambiguous expressions in the Mona Lisa, and extend to other Leonardo's portraits, namely La Bella Principessa and Scapigliata. This study sheds light on the intersection of psychology and art, offering new perspectives on timeless masterpieces.

multidisciplinary sciences
Image Inpainting Forgery Detection: A Review

Adrian-Alin Barglazan,Remus Brad,Constantin Constantinescu

DOI: https://doi.org/10.3390/jimaging10020042

2024-02-02

Journal of Imaging

Abstract:In recent years, significant advancements in the field of machine learning have influenced the domain of image restoration. While these technological advancements present prospects for improving the quality of images, they also present difficulties, particularly the proliferation of manipulated or counterfeit multimedia information on the internet. The objective of this paper is to provide a comprehensive review of existing inpainting algorithms and forgery detections, with a specific emphasis on techniques that are designed for the purpose of removing objects from digital images. In this study, we will examine various techniques encompassing conventional texture synthesis methods as well as those based on neural networks. Furthermore, we will present the artifacts frequently introduced by the inpainting procedure and assess the state-of-the-art technology for detecting such modifications. Lastly, we shall look at the available datasets and how the methods compare with each other. Having covered all the above, the outcome of this study is to provide a comprehensive perspective on the abilities and constraints of detecting object removal via the inpainting procedure in images.

An image processing of a Raphael's portrait of Leonardo

EasyPainter: Customizing Your Own Paintings

Feature-Based Automatic Portrait Generation System

The Digital Restoration of Da Vinci's Sketches

Toward Unbiased High-Quality Portraits through Latent-Space Evaluation

Computational identification of significant actors in paintings through symbols and attributes

Portrait painting using active templates.

Artificial intelligence's interpretation of the neuroanatomical aspect of Peter Paul Rubens's copy of "The Battle of Anghiari" by Leonardo da Vinci

Empathy and the art of Leonardo da Vinci

Cultural heritage digital twin: modeling and representing the visual narrative in Leonardo Da Vinci's Mona Lisa

How does the Italian High Renaissance Artist Raphael Sanzio connect the past, present, and future of the art community?

Artistic Painting By Reference Images

Everyone Can Be Picasso? A Computational Framework into the Myth of Human versus AI Painting

A Data Set and a Convolutional Model for Iconography Classification in Paintings

Learning Portrait Style Representations

A software for aging faces applied to ancient marble busts

Color-Coded Symbology and New Computer Vision Tool to Predict the Historical Color Pallets of the Renaissance Oil Artworks

Automatic Portrait Oil Painter: Joint Domain Stylization for Portrait Images

Leveraging Computer Vision Application in Visual Arts: A Case Study on the Use of Residual Neural Network to Classify and Analyze Baroque Paintings

The psychology of Mona Lisa's smile

Image Inpainting Forgery Detection: A Review