Recognition and Analysis of Kawaii Style for Fashion Clothing Through Deep Learning

Zhu Dan,Lai Xiaojun,Rau Pei-Luen Patrick
DOI: https://doi.org/10.1007/s42454-022-00042-w
2022-01-01
Abstract:With the popularity of Japanese products and kawaii culture in China, understanding how the Chinese perceive kawaii style will help to satisfy their emotional needs in product design. To overcome the problems of expansion difficulty and low efficiency due to expert dependence on traditional methods, this study combines deep learning and Kansei engineering to recognize and analyze the kawaii style by taking female fashion clothing as an example. We build a perceptual annotation database containing 7000 female fashion pictures, each of which has 8 valid kawaii scores labeled by participants, with 4 scores from men and 4 scores from women. Then, we train two neural models and obtain a classification network (kawaii vs. non-kawaii) with 84.45% accuracy and a regression network (the value of kawaii) with an average error of 0.42 points. These recognition models perform better than manual recognition for the kawaii style. In addition, to analyze the kawaii formation of female fashion clothing, we detect the design features of kawaii styles, non-kawaii styles, and gender differences using the neuron analysis method and summarize the corresponding design elements. Finally, using three exploratory experiments, we extend the models to similar products, different types of products, and different visual styles. Overall, we apply deep learning to achieve automatic support in the product design of the kawaii style without the reliance on experts and intensive labor.
What problem does this paper attempt to address?