Abstract:Semantically rich indoor models are increasingly used throughout a facility’s life cycle for different applications. With the decreasing price of 3D sensors, it is convenient to acquire point cloud data from consumer-level scanners. However, most existing methods in 3D indoor reconstruction from point clouds involve a tedious manual or interactive process due to line-of-sight occlusions and complex space structures. Using the multiple types of data obtained by RGB-D devices, this paper proposes a fast and automatic method for reconstructing semantically rich indoor 3D building models from low-quality RGB-D sequences. Our method is capable of identifying and modelling the main structural components of indoor environments such as space, wall, floor, ceilings, windows, and doors from the RGB-D datasets. The method includes space division and extraction, opening extraction, and global optimization. For space division and extraction, rather than distinguishing room spaces based on the detected wall planes, we interactively define the start-stop position for each functional space (e.g., room, corridor, kitchen) during scanning. Then, an interior elements filtering algorithm is proposed for wall component extraction and a boundary generation algorithm is used for space layout determination. For opening extraction, we propose a new noise robustness method based on the properties of convex hull, octrees structure, Euclidean clusters and the camera trajectory for opening generation, which is inapplicable to the data collected in the indoor environments due to inevitable occlusion. A global optimization approach for planes is designed to eliminate the inconsistency of planes sharing the same global plane, and maintain plausible connectivity between the walls and the relationships between the walls and openings. The final model is stored according to the CityGML3.0 standard. Our approach allows for the robust generation of semantically rich 3D indoor models and has strong applicability and reconstruction power for complex real-world datasets.

DIO: Dataset of 3D Mesh Models of Indoor Objects for Robotics and Computer Vision Applications

Indoor Objects 3D Modeling Based on RGB-D Camera for Robot Vision

Mobile3DScanner: an Online 3D Scanner for High-quality Object Reconstruction with a Mobile Device

InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Dataset

Progressive Model-Driven Approach for 3D Modeling of Indoor Spaces

Preproessing and Modeling for Visual-Based 3D Indoor Scene Reconstruction

Object Modelling with a Handheld RGB-D Camera

A Realistic 3-D Reverse Modeling System Based on Real-World Sampling Dataset.

3D indoor scene modeling from RGB-D data: a survey

Reconstructing Indoor Environmental 3D Model Using Laser Range Scanners and Omnidirectional Camera

Online 3D Reconstruction Based On Lidar Point Cloud

Structured3D: A Large Photo-Realistic Dataset for Structured 3D Modeling

Evaluation of the 3D Reconstruction Performance of Objects in Meshroom: A Case Study

A Method to Generate High Precision Mesh Model and RGB-D Datasetfor 6D Pose Estimation Task

DOFS: A Real-world 3D Deformable Object Dataset with Full Spatial Information for Dynamics Model Learning

Generating Large Scale Image Datasets from 3 D CAD Models

A Real 3D Embodied Dataset for Robotic Active Visual Learning

Fast and Automatic Reconstruction of Semantically Rich 3D Indoor Maps from Low-quality RGB-D Sequences

3D Model Retrieval from Multiple Photographic Images

Modeling Indoor Scenes with Repetitions from 3D Raw Point Data

A 3D Modeling Method of Indoor Objects Using Kinect Sensor.