Abstract:A mobile mapping system (MMS) is usually utilized to collect environmental data on and around urban roads. Laser scanners and panoramic cameras are the main sensors of an MMS. This paper presents a new method for the registration of the point clouds and panoramic images based on sensor constellation. After the sensor constellation was analyzed, a feature point, the intersection of the connecting line between the global positioning system (GPS) antenna and the panoramic camera with a horizontal plane, was utilized to separate the point clouds into blocks. The blocks for the central and sideward laser scanners were extracted with the segmentation feature points. Then, the point clouds located in the blocks were separated from the original point clouds. Each point in the blocks was used to find the accurate corresponding pixel in the relative panoramic images via a collinear function, and the position and orientation relationship amongst different sensors. A search strategy is proposed for the correspondence of laser scanners and lenses of panoramic cameras to reduce calculation complexity and improve efficiency. Four cases of different urban road types were selected to verify the efficiency and accuracy of the proposed method. Results indicate that most of the point clouds (with an average of 99.7%) were successfully registered with the panoramic images with great efficiency. Geometric evaluation results indicate that horizontal accuracy was approximately 0.10-0.20 m, and vertical accuracy was approximately 0.01-0.02 m for all cases. Finally, the main factors that affect registration accuracy, including time synchronization amongst different sensors, system positioning and vehicle speed, are discussed.

Panorama based position measurement method of road traffic facilities

Capture Of Vehicle Surroundings Using A Pair Of Panoramic Annular Lens Cameras

A Panoramic Localizer Based on Coarse-to-Fine Descriptors for Navigation Assistance

Panorama-Based Multilane Recognition for Advanced Navigation Map Generation

Automatic mileage positioning for road inspection using binocular stereo vision system and global navigation satellite system

Registration of Vehicle-Borne Point Clouds and Panoramic Images Based on Sensor Constellations

Vision-based Full-Field Panorama Generation by UAV Using GPS Data and Feature Points Filtering

Extrinsic Calibration for Vehicle-based Mobile Mapping System

Automatic Calibration Method for PTZ Camera

A Method of Generating Measurable Panoramic Image for Indoor Mobile Measurement System

3D Laser Scanning and Surveying Adjustment in Traffic Infrastructure Management

Estimation of Vehicle Pose and Position with Monocular Camera at Urban Road Intersections

Monocular BEV Perception of Road Scenes Via Front-to-Top View Projection

Monitoring road base course construction progress by photogrammetry-based 3D reconstruction

A Method of 3D-Gis Application Aided with Stereo Panorama Technology

Vehicle position estimation using geometric constants in traffic scene

Traffic Sign Based Point Cloud Data Registration with Roadside LiDARs in Complex Traffic Environments

AN GROUND AND UNDER-GROUND URBAN ROADS SURVEYING APPROACH USING INTEGRATED 3D LIDAR AND 3D GPR TECHNOLOGY

Automatic Background Construction and Object Detection Based on Roadside LiDAR

Lane-level orthophoto map generation using multiple onboard cameras

An Automatic Road Network Construction Method Using Massive GPS Trajectory Data