Abstract:Semantically rich indoor models are increasingly used throughout a facility’s life cycle for different applications. With the decreasing price of 3D sensors, it is convenient to acquire point cloud data from consumer-level scanners. However, most existing methods in 3D indoor reconstruction from point clouds involve a tedious manual or interactive process due to line-of-sight occlusions and complex space structures. Using the multiple types of data obtained by RGB-D devices, this paper proposes a fast and automatic method for reconstructing semantically rich indoor 3D building models from low-quality RGB-D sequences. Our method is capable of identifying and modelling the main structural components of indoor environments such as space, wall, floor, ceilings, windows, and doors from the RGB-D datasets. The method includes space division and extraction, opening extraction, and global optimization. For space division and extraction, rather than distinguishing room spaces based on the detected wall planes, we interactively define the start-stop position for each functional space (e.g., room, corridor, kitchen) during scanning. Then, an interior elements filtering algorithm is proposed for wall component extraction and a boundary generation algorithm is used for space layout determination. For opening extraction, we propose a new noise robustness method based on the properties of convex hull, octrees structure, Euclidean clusters and the camera trajectory for opening generation, which is inapplicable to the data collected in the indoor environments due to inevitable occlusion. A global optimization approach for planes is designed to eliminate the inconsistency of planes sharing the same global plane, and maintain plausible connectivity between the walls and the relationships between the walls and openings. The final model is stored according to the CityGML3.0 standard. Our approach allows for the robust generation of semantically rich 3D indoor models and has strong applicability and reconstruction power for complex real-world datasets.

Modeling room structure from indoor panorama.

Indoor Structure Understanding from Single 360 Cylindrical Panoramic Image

Indoor Scene Reconstruction: from Panorama Images to CAD Models.

Automatic 3D Indoor Scene Modeling from Single Panorama

DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimization

Efficient 3D Room Shape Recovery from a Single Panorama.

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Manhattan Room Layout Reconstruction from a Single $360^{\circ }$ Image: A Comparative Study of State-of-the-Art Methods.

Modeling Urban Scenes In The Spatial-Temporal Space

Indoor Panorama Planar 3D Reconstruction via Divide and Conquer

A Three Dimensional Measurement Approach and Experiment Based on Spherical Panorama

Multi-resolution Panoramic Modeling Based on Spherical Projective Geometry

Pano2Room: Novel View Synthesis from a Single Indoor Panorama

Three-Dimensional Structure Measurement And Optimization Method Of Indoor Scene Based On Single Image

The Polygonal 3D Layout Reconstruction of an Indoor Environment via Voxel-Based Room Segmentation and Space Partition

Research on Object Panoramic 3D Point Cloud Reconstruction System Based on Structure From Motion

Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Image

Hybrid 3D Reconstruction of Indoor Scenes Integrating Object Recognition

Fast and Automatic Reconstruction of Semantically Rich 3D Indoor Maps from Low-quality RGB-D Sequences

Low-Cost and Efficient Indoor 3D Reconstruction Through Annotated Hierarchical Structure-from-Motion

An Interactive Indoor 3D Reconstruction Method Based on Conformal Geometry Algebra