ShanshuiDaDA: An Interactive, Generative System towards Chinese Shanshui Painting

Aven Le Zhou,Qiufeng Wang,Cheng-Hung Lo,Kaizhu Huang

2023-10-04

Abstract:Shanshui, which means mountain and water, is an East Asian traditional brush painting involving natural landscapes. This paper proposes an interactive and generative system based on a Generative Adversarial Network(GAN), which helps users draw Shanshui easily. We name this system and installation ShanshuiDaDA. ShanshuiDaDA is trained with CycleGAN and wrapped with a web-based interface. When participants scribble lines and sketch the landscape, the ShanshuiDaDA will assist them in generating and creating a Chinese "Shanshui" painting in real time.

Graphics,Human-Computer Interaction,Multimedia

What problem does this paper attempt to address?

The problem this paper attempts to address is: how to use Generative Adversarial Network (GAN) technology to develop an interactive generation system that helps users easily draw traditional Chinese landscape paintings (Shanshui). Specifically, the authors propose a system called "ShanshuiDaDA" to achieve this goal through the following methods:

1. **Dataset Construction**: Due to the lack of ready-made datasets, the authors collected high-resolution scans of landscape paintings and generated a hand-drawn sketch dataset using computer vision methods.

2. **Model Training**: The model was trained using the CycleGAN algorithm to learn the mapping relationship from hand-drawn sketches to landscape paintings.

3. **Interactive Interface**: A web-based interactive interface was developed, allowing users to draw sketches on the interface, and the system generates the corresponding landscape paintings in real-time.

4. **User Experience**: Through this interactive system, modern people, especially those who grew up in an Eastern cultural background, can more easily use landscape painting as a medium of expression, enriching their spiritual life.

In summary, this paper aims to explore the application of artificial intelligence in traditional art creation, enabling more people to experience and create landscape paintings through technological means, thereby inheriting and developing this unique form of Eastern art.