Abstract:The generation of well-designed artwork is often quite time-consuming and assumes a high degree of proficiency on part of the human painter. In order to facilitate the human painting process, substantial research efforts have been made on teaching machines how to "paint like a human", and then using the trained agent as a painting assistant tool for human users. However, current research in this direction is often reliant on a progressive grid-based division strategy wherein the agent divides the overall image into successively finer grids, and then proceeds to paint each of them in parallel. This inevitably leads to artificial painting sequences which are not easily intelligible to human users. To address this, we propose a novel painting approach which learns to generate output canvases while exhibiting a more human-like painting style. The proposed painting pipeline Intelli-Paint consists of 1) a progressive layering strategy which allows the agent to first paint a natural background scene representation before adding in each of the foreground objects in a progressive fashion. 2) We also introduce a novel sequential brushstroke guidance strategy which helps the painting agent to shift its attention between different image regions in a semantic-aware manner. 3) Finally, we propose a brushstroke regularization strategy which allows for ~60-80% reduction in the total number of required brushstrokes without any perceivable differences in the quality of the generated canvases. Through both quantitative and qualitative results, we show that the resulting agents not only show enhanced efficiency in output canvas generation but also exhibit a more natural-looking painting style which would better assist human users express their ideas through digital artwork.

Learning Realistic Sketching: A Dual-agent Reinforcement Learning Approach

Sketch-R2CNN: an Attentive Network for Vector Sketch Recognition

General Virtual Sketching Framework for Vector Line Art

Automatic Image-Based Pencil Sketch Rendering

Learning to Sketch Human Facial Portraits Using Personal Styles by Case-Based Reasoning

Artist Agent: A Reinforcement Learning Approach to Automatic Stroke Generation in Oriental Ink Painting

Learning to Sketch with Deep Q Networks and Demonstrated Strokes

Learning Deep Sketch Abstraction

SketcherX: AI-Driven Interactive Robotic drawing with Diffusion model and Vectorization Techniques

Deep Robot Sketching: An application of Deep Q-Learning Networks for human-like sketching

SmartPaint: a Co-Creative Drawing System Based on Generative Adversarial Networks

Making Robots Draw A Vivid Portrait in Two Minutes.

Sketch-based Creativity Support Tools using Deep Learning

Combining Semantic Guidance and Deep Reinforcement Learning For Generating Human Level Paintings

Picture that Sketch: Photorealistic Image Generation from Abstract Sketches

Sketch-to-Art: Synthesizing Stylized Art Images From Sketches

A Collaborative, Interactive and Context-Aware Drawing Agent for Co-Creative Design

DeepFacePencil: Creating Face Images from Freehand Sketches.

RT-Sketch: Goal-Conditioned Imitation Learning from Hand-Drawn Sketches

On Learning Semantic Representations for Large-Scale Abstract Sketches

Intelli-Paint: Towards Developing Human-like Painting Agents