Abstract:Deep Neural Networks (DNNs) have been successfully used in classifying digital images but have been less successful in classifying images with meanings that are not linear combinations of their visualized features, like images of artwork. Moreover, it is unknown what additional features must be included into DNNs, so that they can possibly classify using features beyond visually displayed features, like color, size, and form. Non-displayed features are important in abstract representations, reasoning, and understanding ambiguous expressions, which are arguably topics less studied by current AI methods. This paper attempts to identify capabilities that are related to semantic processing, a current limitation of DNNs. The proposed methodology identifies the missing capabilities by comparing the process of understanding Mondrian's paintings with the process of understanding electronic circuit designs, another creative problem solving instance. The compared entities are cognitive architectures that attempt to loosely mimic cognitive activities. The paper offers a detailed presentation of the characteristics of the architectural components, like goals, concepts, ideas, rules, procedures, beliefs, expectations, and outcomes. To explain the usefulness of the methodology, the paper discusses a new, three-step computational method to distinguish Mondrian's paintings from other artwork. The method includes in a backward order the cognitive architecture's components that operate only with the characteristics of the available data.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to understand non - explicit features (NEXP) in artworks, especially those of the abstract artist Mondrian, through computational methods. Currently, deep neural networks (DNNs) have achieved success in image classification, but they perform poorly when dealing with artworks with complex and elusive non - explicit attributes. These non - explicit features include the artist's intention and the viewer's perception, etc., which cannot be simply described by a linear combination of visual features such as color, size, and shape. Therefore, the goal of the paper is to identify the missing capabilities in current DNNs, which are crucial for effectively identifying and using NEXP for art - work classification.
To achieve this goal, the paper proposes a new methodology. This methodology identifies these missing capabilities by comparing the process of understanding Mondrian's paintings with that of understanding electronic circuit design. Both of these processes are instances of creative problem - solving. Through this comparison, it can be revealed which cognitive architecture components are required in understanding abstract artworks. These components include goals, concepts, ideas, rules, procedures, beliefs, expectations, and results, etc. By analyzing the characteristics of these components in detail, the paper provides a three - step computational method to distinguish Mondrian's paintings from other artworks, thus promoting the automation process of understanding abstract artworks.