Abstract:Traditional indoor laser scanning trolley/backpacks with multi-laser scanner, panorama cameras, and an inertial measurement unit (IMU) installed are a popular solution to the 3D indoor mapping problem. However, the cost of those mapping suits is quite expensive, and can hardly be replicated by consumer electronic components. The consumer RGB-Depth (RGB-D) camera (e.g., Kinect V2) is a low-cost option for gathering 3D point clouds. However, because of the narrow field of view (FOV), its collection efficiency and data coverages are lower than that of laser scanners. Additionally, the limited FOV leads to an increase of the scanning workload, data processing burden, and risk of visual odometry (VO)/simultaneous localization and mapping (SLAM) failure. To find an efficient and low-cost way to collect 3D point clouds data with auxiliary information (i.e., color) for indoor mapping, in this paper we present a prototype indoor mapping solution that is built upon the calibration of multiple RGB-D sensors to construct an array with large FOV. Three time-of-flight (ToF)-based Kinect V2 RGB-D cameras are mounted on a rig with different view directions in order to form a large field of view. The three RGB-D data streams are synchronized and gathered by the OpenKinect driver. The intrinsic calibration that involves the geometry and depth calibration of single RGB-D cameras are solved by homography-based method and ray correction followed by range biases correction based on pixel-wise spline line functions, respectively. The extrinsic calibration is achieved through a coarse-to-fine scheme that solves the initial exterior orientation parameters (EoPs) from sparse control markers and further refines the initial value by an iterative closest point (ICP) variant minimizing the distance between the RGB-D point clouds and the referenced laser point clouds. The effectiveness and accuracy of the proposed prototype and calibration method are evaluated by comparing the point clouds derived from the prototype with ground truth data collected by a terrestrial laser scanner (TLS). The overall analysis of the results shows that the proposed method achieves the seamless integration of multiple point clouds from three Kinect V2 cameras collected at 30 frames per second, resulting in low-cost, efficient, and high-coverage 3D color point cloud collection for indoor mapping applications.

3D Shape, Deformation, and Vibration Measurements Using Infrared Kinect Sensors and Digital Image Correlation.

IR Stereo RealSense: Decreasing Minimum Range of Navigational Assistance for Visually Impaired Individuals.

High-speed 360 3D shape measurement based on visual stereo phase unwrapping method

Depth and Thermal Sensor Fusion to Enhance 3D Thermographic Reconstruction

Scanning 3D Full Human Bodies Using Kinects

Robust 3D Reconstruction with an RGB-D Camera

A High Spatial Resolution Depth Sensing Method Based on Binocular Structured Light

High-resolution Real-Time 3D Absolute Coordinates Measurement Using a Fast Three-Step Phase-Shifting Algorithm

Multi-sensor Spatial Augmented Reality for Visualizing the Invisible Thermal Information of 3D Objects

Real-time 3d reconstruction of dynamic scenes with multiple kinect v2 sensors

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

Reconstructing 3D Human Models with a Kinect

Real-time 3D human objects rendering based on multiple camera details

Volumeter: 3D human body parameters measurement with a single Kinect

Calibrate Multiple Consumer Rgb-D Cameras For Low-Cost And Efficient 3d Indoor Mapping

High-precision Real-Time 3D Shape Measurement Based on a Quad-Camera System

Depth-color fusion strategy for 3-D scene modeling with Kinect

Microsoft Azure Kinect Calibration for Three-Dimensional Dense Point Clouds and Reliable Skeletons

Real-time and Robust Feature Detection of Continuous Marker Pattern for Dense 3-D Deformation Measurement

Low-cost Gaze and Pulse Analysis Using RealSense

Study on the rotary human body scanning system based on multiple Kinects