Understanding and Creating Art with AI: Review and Outlook

Eva Cetinic,James She
2021-02-18
Abstract:Technologies related to artificial intelligence (AI) have a strong impact on the changes of research and creative practices in visual arts. The growing number of research initiatives and creative applications that emerge in the intersection of AI and art, motivates us to examine and discuss the creative and explorative potentials of AI technologies in the context of art. This paper provides an integrated review of two facets of AI and art: 1) AI is used for art analysis and employed on digitized artwork collections; 2) AI is used for creative purposes and generating novel artworks. In the context of AI-related research for art understanding, we present a comprehensive overview of artwork datasets and recent works that address a variety of tasks such as classification, object detection, similarity retrieval, multimodal representations, computational aesthetics, etc. In relation to the role of AI in creating art, we address various practical and theoretical aspects of AI Art and consolidate related works that deal with those topics in detail. Finally, we provide a concise outlook on the future progression and potential impact of AI technologies on our understanding and creation of art.
Computer Vision and Pattern Recognition,Artificial Intelligence,Multimedia
What problem does this paper attempt to address?
The paper primarily explores two key application directions of artificial intelligence (AI) in the field of art: 1. using AI technology to analyze existing artworks; 2. using AI technology to create new artworks. In terms of artwork analysis, the paper reviews the research progress on using AI technology, particularly computer vision and deep learning methods, for tasks such as classification, object detection, and similarity retrieval of artworks. These works rely on large-scale digitized artwork datasets and enhance the understanding and analysis capabilities of artworks through automated means. For example, convolutional neural networks (CNNs) are widely used in classification tasks related to artists, styles, genres, etc., and have achieved significant results. In the creation of artworks, the paper discusses how AI technology can be used to generate new artistic creations. With the emergence and development of generative adversarial networks (GANs), AI-generated artworks have been receiving increasing attention. GANs can generate artistic images with innovation and uniqueness, marking a substantial breakthrough in the potential of AI in artistic creation. Additionally, the paper emphasizes the importance of interdisciplinary collaboration, especially between the fields of computer science and art history, to promote the development of digital art history research, and proposes future research directions and technical challenges. In summary, this paper aims to comprehensively review and forecast the applications of AI in art understanding and creation, and discusses the development trends of related technologies and theories.