Abstract:Three dimensional data is in great demand for the various applications. In order to represent 3D space in details, it is indispensable to acquire 3D shape and texture together efficiently. However, there still lack a reliable, quick, cheap and handy method of acquiring three dimensional data of objects at higher resolution and accuracy in outdoor and moving environments. In this research, we propose a combination of a digital camera and a small (cheap) laser scanner with inexpensive IMU and GPS for an unmanned helicopter. Direct geo-referencing is achieved automatically using all the sensors without any ground control points. After the accurate trajectory of the platform with attitude changes are determined through the direct geo-referencing, 3D shape of objects is determined by laser scanner as 3D point cloud data, while texture is acquired by CCD sensor from the same platform simultaneously. A method of direct geo-referencing of range data and CCD images by integrating multi sensors for constructing digital surface model are focused. While measuring, an unmanned helicopter is continuously changing its position and attitude with respect to time. For direct geo-referencing, IMU measures the movement of the platform. IMU has a rising quality, but it is still affected by systematic errors. Through Kalman filter operation, an optimal estimate of the sensor position and attitude are determined from GPS and IMU. Meanwhile, geo-referencing of CCD image is determined by bundle block adjustment. GPS and IMU allow automatic setting of tie-points and they reduce the number of tie-points and searching time of tie-points by limiting of searching area. The result of bundle block adjustment aids Kalman filter. IMU are initialized for Kalman filter using the result of bundle block adjustment. That is, after every bundle block adjustment, IMU and its error are complemented. Geo-referencing of laser range data is done by using the result of aiding Kalman filter. Therefore, geo-referencing of range data and CCD images is done directly to overlap exactly with high accuracy and high resolution. The method of data acquisition and digital surface modelling is developed by direct geo-referencing of laser range data and CCD images with GPS and IMU. This is the way of rendering objects with rich shape and detailed texture automatically. A new method of direct geo-referencing by the combination of bundle block adjustment and Kalman filter is proposed. * Corresponding author. Masahiko Nagai, Tel:+81-3-5452-6417 E-mail: nagaim@iis.u-tokyo.ac.jp

Semi-Real-Time Direct Geo-Referencing of Integrated Laser Scanning and CCD Sensor by Combining GPS/IMU and Bundle Block Adjustment of CCD Images

Construction of digital surface model by multi-sensor integration from an unmanned helicopter

Development of digital surface model and feature extraction by integrating laser scanner and ccd sensor with imu

Automatic Calibration Between Multi-Lines LiDAR and Visible Light Camera Based on Edge Refinement and Virtual Mask Matching

IMU and Multiple RGB-D Camera Fusion for Assisting Indoor Stop-and-Go 3D Terrestrial Laser Scanning

Coarse-to-fine Hybrid 3D Mapping System with Co-calibrated Omnidirectional Camera and Non-repetitive LiDAR

Real-time 3D mapping using a 2D laser scanner and IMU-aided visual SLAM

A Compact Handheld Sensor Package with Sensor Fusion for Comprehensive and Robust 3D Mapping

Self-calibrated dense 3D sensor using multiple cross line-lasers based on light sectioning method and visual odometry

A Robust Registration Method for the Reconstruction of 3D Urban Objects using Ground-based Laser Range Scanner.

Stereo Camera Visual SLAM with Hierarchical Masking and Motion-state Classification at Outdoor Construction Sites Containing Large Dynamic Objects

An Efficient Extrinsic Calibration Of A Multiple Laser Scanners And Cameras' Sensor System On A Mobile Platform

Direct Georeferencing for the Images in an Airborne LiDAR System by Automatic Boresight Misalignments Calibration

Research on SLAM Algorithm of Mobile Robot Based on the Fusion of 2D LiDAR and Depth Camera

Updating a digital geographic database using vehicle-borne laser scanners and line cameras

MOBILE LASER SCANNING WITH LOW-COST NAVIGATION SENSORS: COMPENSATING FOR LOW-GRADE IMU WITH DUAL-GNSS AND TIGHTLY-COUPLED LIDAR

An Enhanced Multi-Sensor Simultaneous Localization and Mapping (SLAM) Framework with Coarse-to-Fine Loop Closure Detection Based on a Tightly Coupled Error State Iterative Kalman Filter

Stereo and LiDAR Loosely Coupled SLAM Constrained Ground Detection

S4-SLAM: A real-time 3D LIDAR SLAM system for ground/watersurface multi-scene outdoor applications