Abstract:Architects are used to hand drawing sketches to express the architectural creation intention.To present these abstract sketches, architects and teams need to convert sketches into architectural scheme images, which requires a lot of time and labour.Deep learning may have the potential to improve the efficiency of this work.The common sketch-to-image generation is based on Generative Adversarial Network (GAN), and the research of edge-to-image has made a big progress.But these methods require strict alignment of data pairs, which is difficult to achieve.Zhu et al. proposed the loss of Cycle-Consistent, which solved the problem that pairs of data sets are difficult to collect.However, most of the image translation methods require strict alignment between image data pairs, which can be achieved only for the edge mapping extracted from the image; but the sketch is very different from the edge.Due to the abstractness and fuzziness of the sketch, any simple distortion cannot complete the task of providing pixel-level alignment between the sketch and image; And image translation is the transfer of image features such as colour and texture.The original image has a strong constraint on the generated image, which makes the original structure of the image impossible to be changed.By image inpainting, we address this topic using a joint image completion approach with Context-Encoder, where the architectural sketch provides the image context for generating the scheme images.This setting has two advantages: first, the joint images can avoid the complexity of cross modal problems and the strict alignment of the data pairs as image-to-image translation; second, because of the weak constraint, the outputs have greater freedom, which perhaps can generate more imaginative results.The Context-Encoder generates scheme images on the data sets of general architectural sketches.The results present that the applicability of the completion method is better than that of the method of image translation.And scheme images that is different from the original architectural sketch contours have been generated.

Coloring and fusing architectural sketches by combining a Y‐shaped generative adversarial network and a denoising diffusion implicit model

Sketch to Building: Architecture Image Translation Based on GAN

A self‐sparse generative adversarial network for autonomous early‐stage design of architectural sketches

Artificial intelligence-designer for high-rise building sketches with user preferences

UGSC‐GAN: User‐guided sketch colorization with deep convolution generative adversarial networks

Enhancing Urban Landscape Design: A GAN-Based Approach for Rapid Color Rendering of Park Sketches

AI-Sketcher : A Deep Generative Model for Producing High-Quality Sketches.

Sketch-to-Architecture: Generative AI-aided Architectural Design

SmartPaint: a Co-Creative Drawing System Based on Generative Adversarial Networks

DiffSketching: Sketch Control Image Synthesis with Diffusion Models

Automatic generation of architecture facade for historical urban renovation using generative adversarial network

Research on Architectural Sketch to Scheme Image Based on Context Encoder

GGD-GAN: Gradient-Guided Dual-Branch Adversarial Networks for Relic Sketch Generation

MasterplanGAN: Facilitating the Smart Rendering of Urban Master Plans Via Generative Adversarial Networks

Edge Aware Domain Transformation for Face Sketch Synthesis

Visual‐attention GAN for Interior Sketch Colourisation

Face Sketch Synthesis via Semantic-Driven Generative Adversarial Network

DRAWING WITH BOTS: HUMAN-COMPUTER COL-LABORATIVE DRAWING EXPERIMENTS

Spatial Fusion GAN for Image Synthesis

Adversarial Interactive Cartoon Sketch Colourization with Texture Constraint and Auxiliary Auto-Encoder.

Magic Pencil