Abstract:There has been a growing adoption of computer vision tools and technologies in architectural design workflows over the past decade. Notable use cases include point cloud generation, visual content analysis, and spatial awareness for robotic fabrication. Multiple image classification, object detection, and semantic pixel segmentation models have become popular for the extraction of high-level symbolic descriptions and semantic content from two-dimensional images and videos. However, a major challenge in this regard has been the extraction of high-level architectural structures (walls, floors, ceilings windows etc.) from diverse imagery where parts of these elements are occluded by furniture, people, or other non-architectural elements. This project aims to tackle this problem by proposing models that are capable of extracting architecturally meaningful semantic descriptions from two-dimensional scenes of populated interior spaces. 1000 virtual classrooms are parametrically generated, randomized along key spatial parameters such as length, width, height, and door/window positions. The positions of cameras, and non-architectural visual obstructions (furniture/objects) are also randomized. A Generative Adversarial Network (GAN) for image-to-image translation (Pix2Pix) is trained on synthetically generated rendered images of these enclosures, along with corresponding image abstractions representing high-level architectural structure. The model is then tested on unseen synthetic imagery of new enclosures, and outputs are compared to ground truth using pixel-wise comparison for evaluation. A similar model evaluation is also carried out on photographs of existing indoor enclosures, to measure its performance in real-world settings.

DRAWING WITH BOTS: HUMAN-COMPUTER COL-LABORATIVE DRAWING EXPERIMENTS

Generative Creativity: Adversarial Learning For Bionic Design

SmartPaint: a Co-Creative Drawing System Based on Generative Adversarial Networks

Towards AI Drawing Agents

Automated urban planning aware spatial hierarchies and human instructions

Artificial Intelligence to Facilitate the Conceptual Stage of Interior Space Design: Conditional Generative Adversarial Network-Supported Long-Term Care Space Floor Plan Design of Retirement Home Buildings

A self‐sparse generative adversarial network for autonomous early‐stage design of architectural sketches

A Collaborative, Interactive and Context-Aware Drawing Agent for Co-Creative Design

Enhancing Urban Landscape Design: A GAN-Based Approach for Rapid Color Rendering of Park Sketches

Automatic Measures for Evaluating Generative Design Methods for Architects

House-GAN++: Generative Adversarial Layout Refinement Network towards Intelligent Computational Agent for Professional Architects

GAN-based AI Drawing Board for Image Generation and Colorization

Artificial intelligence-designer for high-rise building sketches with user preferences

Coloring and fusing architectural sketches by combining a Y‐shaped generative adversarial network and a denoising diffusion implicit model

UDGAN: A new urban design inspiration approach driven by using generative adversarial networks

City-GAN: Learning architectural styles using a custom Conditional GAN architecture

Sketch to Building: Architecture Image Translation Based on GAN

Intelligent Home 3D: Automatic 3D-House Design from Linguistic Descriptions Only

Automated building layout generation using deep learning and graph algorithms

Learning What and Where to Draw

Unveiling Spaces: Architecturally meaningful semantic descriptions from images of interior spaces