Abstract:Research domain and Problem: HBIM modelling from point cloud data has become a crucial research topic in the last decade since it is potentially considered the central data model paving the way for the digital heritage practice beyond digitization. Reality Capture technologies such as terrestrial laser scanning, drone-mounted LiDAR sensors and photogrammetry enable the reality capture with a sub-millimetre accurate point cloud file that can be used as a reference file for Heritage Building Information Modelling (HBIM). However, HBIM modelling from the point cloud data of heritage buildings is mainly manual, error-prone, and time-consuming. Furthermore, image processing techniques are insufficient for classification and segmenting of point cloud data to speed up and enhance the current workflow for HBIM modelling. Due to the challenges and bottlenecks in the scan-to-HBIM process, which is commonly criticized as complex with its bespoke requirements, semantic segmentation of point clouds is gaining popularity in the literature. Research Aim and Methodology: Therefore, this paper aims to provide a thorough critical review of Machine Learning and Deep Learning methods for point cloud segmentation, classification, and BIM geometry automation for cultural heritage case study applications. Research findings: This paper files the challenges of HBIM practice and the opportunities for semantic point cloud segmentation found across academic literature in the last decade. Beyond definitions and basic occurrence statistics, this paper discusses the success rates and implementation challenges of machine and deep learning classification methods. Research value and contribution: This paper provides a holistic review of point cloud segmentation and its potential for further development and application in the Cultural Heritage sector. The critical analysis provides insight into the current state-of-the-art methods and advises on their suitability for HBIM projects. The review has identified highly original threads of research, which hold the potential to significantly influence practice and further applied research. HBIM, Point Cloud, Semantic Segmentation, Classification, Machine Learning, Deep Learning

Classification of Building Information Model (BIM) Structures with Deep Learning

Building Information Modeling and Classification by Visual Learning At A City Scale

Automatic Fine-Grained BIM element classification using Multi-Modal deep learning (MMDL)

A Geometric-Relational Deep Learning Framework for BIM Object Classification

A geometric deep learning approach for checking element-to-entity mappings in infrastructure building information models

Deep Learning Architect: Classification for Architectural Design through the Eye of Artificial Intelligence

Deep Learning Architect: Classification for Architectural Design Using Artificial Intelligence

Automated BIM generation for large-scale indoor complex environments based on deep learning

AUTOMATED SEMANTIC MODELLING OF BUILDING INTERIORS FROM IMAGES AND DERIVED POINT CLOUDS BASED ON DEEP LEARNING METHODS

Deep-Learning-Based Automated Building Information Modeling Reconstruction Using Orthophotos with Digital Surface Models

Reconstructing BIM from 2D Structural Drawings for Existing Buildings

A Deep Learning-Based Method to Detect Components from Scanned Structural Drawings for Reconstructing 3D Models

Deep Learning Approach to Point Cloud Scene Understanding for Automated Scan to 3D Reconstruction

Deep Learning from Parametrically Generated Virtual Buildings for Real-World Object Recognition

Leveraging Deep Learning for Automated Reconstruction of Indoor Unstructured Elements in Scan-to-BIM

Machine and Deep Learning Implementations for Heritage Building Information Modelling: A Critical Review of Theoretical and Applied Research

H-BIM and Artificial Intelligence: Classification of Architectural Heritage for Semi-Automatic Scan-to-BIM Reconstruction

From the Semantic Point Cloud to Heritage-Building Information Modeling: A Semiautomatic Approach Exploiting Machine Learning

Classification of residential and non-residential buildings based on satellite data using deep learning

BIM Hyperreality: Data Synthesis Using BIM and Hyperrealistic Rendering for Deep Learning

Semantic Enrichment of a BIM Model Using Revit: Automatic Annotation of Doors in High-Rise Residential Building Models Using Machine Learning