Abstract:Three dimensional data is in great demand for the various applications. In order to represent 3D space in details, it is indispensable to acquire 3D shape and texture together efficiently. However, there still lack a reliable, quick, cheap and handy method of acquiring three dimensional data of objects at higher resolution and accuracy in outdoor and moving environments. In this research, we propose a combination of a digital camera and a small (cheap) laser scanner with inexpensive IMU and GPS for an unmanned helicopter. Direct geo-referencing is achieved automatically using all the sensors without any ground control points. After the accurate trajectory of the platform with attitude changes are determined through the direct geo-referencing, 3D shape of objects is determined by laser scanner as 3D point cloud data, while texture is acquired by CCD sensor from the same platform simultaneously. A method of direct geo-referencing of range data and CCD images by integrating multi sensors for constructing digital surface model are focused. While measuring, an unmanned helicopter is continuously changing its position and attitude with respect to time. For direct geo-referencing, IMU measures the movement of the platform. IMU has a rising quality, but it is still affected by systematic errors. Through Kalman filter operation, an optimal estimate of the sensor position and attitude are determined from GPS and IMU. Meanwhile, geo-referencing of CCD image is determined by bundle block adjustment. GPS and IMU allow automatic setting of tie-points and they reduce the number of tie-points and searching time of tie-points by limiting of searching area. The result of bundle block adjustment aids Kalman filter. IMU are initialized for Kalman filter using the result of bundle block adjustment. That is, after every bundle block adjustment, IMU and its error are complemented. Geo-referencing of laser range data is done by using the result of aiding Kalman filter. Therefore, geo-referencing of range data and CCD images is done directly to overlap exactly with high accuracy and high resolution. The method of data acquisition and digital surface modelling is developed by direct geo-referencing of laser range data and CCD images with GPS and IMU. This is the way of rendering objects with rich shape and detailed texture automatically. A new method of direct geo-referencing by the combination of bundle block adjustment and Kalman filter is proposed. * Corresponding author. Masahiko Nagai, Tel:+81-3-5452-6417 E-mail: nagaim@iis.u-tokyo.ac.jp

Development of digital surface model and feature extraction by integrating laser scanner and ccd sensor with imu

Construction of digital surface model by multi-sensor integration from an unmanned helicopter

A clustering approach to free form surface reconstruction from multi-view range images

Semi-Real-Time Direct Geo-Referencing of Integrated Laser Scanning and CCD Sensor by Combining GPS/IMU and Bundle Block Adjustment of CCD Images

Panoramic Three-Dimensional Optical Digitization System Assisted by a Bi-Mirror.

A Real-Time Interactive System of Surface Reconstruction and Dynamic Projection Mapping with RGB-depth Sensor and Projector.

A Compact Handheld Sensor Package with Sensor Fusion for Comprehensive and Robust 3D Mapping

Coarse-to-fine Hybrid 3D Mapping System with Co-calibrated Omnidirectional Camera and Non-repetitive LiDAR

Self-calibrated dense 3D sensor using multiple cross line-lasers based on light sectioning method and visual odometry

IMU and Multiple RGB-D Camera Fusion for Assisting Indoor Stop-and-Go 3D Terrestrial Laser Scanning

Three-Dimensional Geometric-Physical Modeling of an Environment with an In-House-Developed Multi-Sensor Robotic System

3D Mapping Based on Fusion of 2D Laser and IMU Data Acquired by Unmanned Aerial Vehicle

Real-time 3D mapping using a 2D laser scanner and IMU-aided visual SLAM

3D point-cloud mapping using laser scanner mounted on two-wheeled vehicle based on NDT scan matching

A Dynamic Object Removing 3D Reconstruction System Based on Multi-Sensor Fusion

A Robust Registration Method for the Reconstruction of 3D Urban Objects using Ground-based Laser Range Scanner.

Panoramic Image and Three-Axis Laser Scanner Integrated Approach for Indoor 3D Mapping.

Autonomous 3D geometry reconstruction through robot-manipulated optical sensors

In situ three-dimensional laser machining system integrating in situ measurement, reconstruction, parameterization, and texture mapping