Abstract:We present 360-DFPE, a sequential floor plan estimation method that directly takes 360-images as input without relying on active sensors or 3D information. Our approach leverages a loosely coupled integration between a monocular visual SLAM solution and a monocular 360-room layout approach, which estimate camera poses and layout geometries, respectively. Since our task is to sequentially capture the floor plan using monocular images, the entire scene structure, room instances, and room shapes are unknown. To tackle these challenges, we first handle the scale difference between visual odometry and layout geometry via formulating an entropy minimization process, which enables us to directly align 360-layouts without knowing the entire scene in advance. Second, to sequentially identify individual rooms, we propose a novel room identification algorithm that tracks every room along the camera exploration using geometry information. Lastly, to estimate the final shape of the room, we propose a shortest path algorithm with an iterative coarse-to-fine strategy, which improves prior formulations with higher accuracy and faster run-time. Moreover, we collect a new floor plan dataset with challenging large-scale scenes, providing both point clouds and sequential 360-image information. Experimental results show that our monocular solution achieves favorable performance against the current state-of-the-art algorithms that rely on active sensors and require the entire scene reconstruction data in advance.

Structural Deep Metric Learning for Room Layout Estimation

Spatial Geometric Reasoning for Room Layout Estimation via Deep Reinforcement Learning

Edge-Semantic Learning Strategy for Layout Estimation in Indoor Environment

RoomStructNet: Learning to Rank Non-Cuboidal Room Layouts From Single View

3D Room Layout Estimation from a Single RGB Image.

GeoLayout: Geometry Driven Room Layout Estimation Based on Depth Maps of Planes

Estimating spatial layout of rooms from RGB-D videos.

Self-supervised 360$^{\circ}$ Room Layout Estimation

LA-Net: Layout-Aware Dense Network for Monocular Depth Estimation.

LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Rendering

Transferable End-to-end Room Layout Estimation via Implicit Encoding

Towards Interpretable Deep Metric Learning with Structural Matching

Layouts from Panoramic Images with Geometry and Deep Learning

DuLa-Net: A Dual-Projection Network for Estimating Room Layouts from a Single RGB Panorama

360-DFPE: Leveraging Monocular 360-Layouts for Direct Floor Plan Estimation

3D Room Layout Estimation from a Cubemap of Panorama Image Via Deep Manhattan Hough Transform

Estimating Generic 3D Room Structures from 2D Annotations

Deep Layout of Custom-size Furniture through Multiple-domain Learning

3D Room Layout Estimation Beyond the Manhattan World Assumption

From Edge to Keypoint: An End-to-End Framework For Indoor Layout Estimation

Monocular Spherical Depth Estimation with Explicitly Connected Weak Layout Cues