Abstract:Text conditioned generative models for images have yielded impressive results. Text conditioned floorplan generation as a special type of raster image generation task also received particular attention. However there are many use cases in floorpla generation where numerical properties of the generated result are more important than the aesthetics. For instance, one might want to specify sizes for certain rooms in a floorplan and compare the generated floorplan with given specifications Current approaches, datasets and commonly used evaluations do not support these kinds of constraints. As such, an attractive strategy is to generate an intermediate data structure that contains numerical properties of a floorplan which can be used to generate the final floorplan image. To explore this setting we (1) construct a new dataset for this data-structure to data-structure formulation of floorplan generation using two popular image based floorplan datasets RPLAN and ProcTHOR-10k, and provide the tools to convert further procedurally generated ProcTHOR floorplan data into our format. (2) We explore the task of floorplan generation given a partial or complete set of constraints and we design a series of metrics and benchmarks to enable evaluating how well samples generated from models respect the constraints. (3) We create multiple baselines by finetuning a large language model (LLM), Llama3, and demonstrate the feasibility of using floorplan data structure conditioned LLMs for the problem of floorplan generation respecting numerical constraints. We hope that our new datasets and benchmarks will encourage further research on different ways to improve the performance of LLMs and other generative modelling techniques for generating designs where quantitative constraints are only partially specified, but must be respected.

Automatic Rendering of Building Floor Plan Images from Textual Descriptions in English

From Text to Blueprint: Leveraging Text-to-Image Tools for Floor Plan Creation

SUGAMAN: Describing Floor Plans for Visually Impaired by Annotation Learning and Proximity based Grammar

Floor plan generation: The interplay among data, machine, and designer

Intelligent Home 3D: Automatic 3D-House Design from Linguistic Descriptions Only

Data-driven Interior Plan Generation for Residential Buildings.

Deep learning-based text detection and recognition on architectural floor plans

AUTOMATIC 3D BUILDING MODEL GENERATION USING DEEP LEARNING METHODS BASED ON CITYJSON AND 2D FLOOR PLANS

Unveiling Spaces: Architecturally meaningful semantic descriptions from images of interior spaces

A novel feature transform framework using deep neural network for multimodal floor plan retrieval

Automatic Digitization and Orientation of Scanned Mesh Data for Floor Plan and 3D Model Generation

3-Phase Recognition Approach to Pseudo 3D Building Generation from 2D Floor Plan

AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homes

3D Residential Reconstruction from a Single Indoor Floor Plan.

Neural Rendering in a Room: Amodal 3D Understanding and Free-Viewpoint Rendering for the Closed Scene Composed of Pre-Captured Objects

End-to-end Generative Floor-plan and Layout with Attributes and Relation Graph

DStruct2Design: Data and Benchmarks for Data Structure Driven Generative Floor Plan Design

FloorNet: A Unified Framework for Floorplan Reconstruction from 3D Scans

Automatic Reconstruction of Semantic 3D Models from 2D Floor Plans

Data-driven floor plan understanding in rural residential buildings via deep recognition

Graph2Plan: Learning Floorplan Generation from Layout Graphs