Abstract:Semantically rich indoor models are increasingly used throughout a facility’s life cycle for different applications. With the decreasing price of 3D sensors, it is convenient to acquire point cloud data from consumer-level scanners. However, most existing methods in 3D indoor reconstruction from point clouds involve a tedious manual or interactive process due to line-of-sight occlusions and complex space structures. Using the multiple types of data obtained by RGB-D devices, this paper proposes a fast and automatic method for reconstructing semantically rich indoor 3D building models from low-quality RGB-D sequences. Our method is capable of identifying and modelling the main structural components of indoor environments such as space, wall, floor, ceilings, windows, and doors from the RGB-D datasets. The method includes space division and extraction, opening extraction, and global optimization. For space division and extraction, rather than distinguishing room spaces based on the detected wall planes, we interactively define the start-stop position for each functional space (e.g., room, corridor, kitchen) during scanning. Then, an interior elements filtering algorithm is proposed for wall component extraction and a boundary generation algorithm is used for space layout determination. For opening extraction, we propose a new noise robustness method based on the properties of convex hull, octrees structure, Euclidean clusters and the camera trajectory for opening generation, which is inapplicable to the data collected in the indoor environments due to inevitable occlusion. A global optimization approach for planes is designed to eliminate the inconsistency of planes sharing the same global plane, and maintain plausible connectivity between the walls and the relationships between the walls and openings. The final model is stored according to the CityGML3.0 standard. Our approach allows for the robust generation of semantically rich 3D indoor models and has strong applicability and reconstruction power for complex real-world datasets.

3D indoor scene modeling from RGB-D data: a survey

Analysis and Modeling of 3D Indoor Scenes

Learning 3 D Scene Synthesis from Annotated RGB-D Images

Automatic Semantic Modeling of Indoor Scenes from Low-Quality RGB-D Data Using Contextual Information

High-quality indoor scene 3D reconstruction with RGB-D cameras: A brief review

An Interactive Approach to Semantic Modeling of Indoor Scenes with an RGBD Camera

Fast and Automatic Reconstruction of Semantically Rich 3D Indoor Maps from Low-quality RGB-D Sequences

3D Indoor Environment Modeling and Detection of Moving Object and Scene Understanding

Singe Image-Based Data-Driven Indoor Scenes Modeling

Data-Driven Indoor Scene Modeling from a Single Color Image with Iterative Object Segmentation and Model Retrieval

A New Era of Indoor Scene Reconstruction: A Survey

Advances in Data-Driven Analysis and Synthesis of 3D Indoor Scenes

A Review of Techniques for 3D Reconstruction of Indoor Environments

Indoor Scene Understanding in 2.5/3D for Autonomous Agents: A Survey

Automatic 3d Indoor Scene Updating with Rgbd Cameras

Automatic 3D Indoor Scene Modeling from Single Panorama

ARKitScenes - A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Data

A Survey of 3D Indoor Scene Synthesis

Data-driven contextual modeling for 3D scene understanding

Model-driven Indoor Scenes Modeling from a Single Image.

Real-time Dense 3D Semantic Mapping Using RGB-D Camera