Abstract:With state-of-the-art sensing and photogrammetric techniques, Microsoft Bing Maps team has created over 125 highly detailed 3D cities from 11 different countries that cover hundreds of thousands of square kilometer areas. The 3D city models were created using the photogrammetric technique with high-resolution images that were captured from aircraft-mounted cameras. Such a large 3D city database has caught the attention of the US Army for creating virtual simulation environments to support military operations. However, the 3D city models do not have semantic information such as buildings, vegetation, and ground and cannot allow sophisticated user-level and system-level interaction. At I/ITSEC 2019, the authors presented a fully automated data segmentation and object information extraction framework for creating simulation terrain using UAV-based photogrammetric data. This paper discusses the next steps in extending our designed data segmentation framework for segmenting 3D city data. In this study, the authors first investigated the strengths and limitations of the existing framework when applied to the Bing data. The main differences between UAV-based and aircraft-based photogrammetric data are highlighted. The data quality issues in the aircraft-based photogrammetric data, which can negatively affect the segmentation performance, are identified. Based on the findings, a workflow was designed specifically for segmenting Bing data while considering its characteristics. In addition, since the ultimate goal is to combine the use of both small unmanned aerial vehicle (UAV) collected data and the Bing data in a virtual simulation environment, data from these two sources needed to be aligned and registered together. To this end, the authors also proposed a data registration workflow that utilized the traditional iterative closest point (ICP) with the extracted semantic information.

Towards TerraSAR-X Street View: Creating city point cloud from multi-aspect data stacks

Feature-based Fusion of Tomosar Point Clouds from Multiview TerraSAR-X Data Stacks

Automatic Feature-Based Geometric Fusion of Multiview TomoSAR Point Clouds in Urban Area

Fusing Spaceborne Sar Interferometry And Street View Images For 4d Urban Modeling

Efficient Volumetric Fusion of Airborne and Street-Side Data for Urban Reconstruction

An Efficient Tomographic Inversion Approach for Urban Mapping Using Meter Resolution SAR Image Stacks

High Quality Large-Scale 3-D Urban Mapping with Multi-Master TomoSAR

Non-Local SAR Tomography for Large-Scale Urban Mapping

SAR Tomography at the Limit: Building Height Reconstruction Using Only 3-5 TanDEM-X Bistatic Interferograms

Large-Scale Urban Mapping using Small Stack Multi-baseline TanDEM-X Interferograms

Generation of Large Scale 3-D City Models Using Insar and Optical Data

Spaceborne TomoSAR and Beyond: from SAR Image Stacks to Objects

Fusing meter-resolution 4-D InSAR point clouds and optical images for semantic urban infrastructure monitoring

Generation of Large-Scale High Quality 3-D Urban Models

A Framework for SAR-Optical Stereogrammetry over Urban Areas

Urban SAR Tomography With Z-Structure Constraint of Buildings

Automatic registration of a single SAR image and GIS building footprints in a large-scale urban area

Reconstructing 2-D/3-D Building Shapes from Spaceborne Tomographic Synthetic Aperture Radar Data

Semantic Segmentation and Data Fusion of Microsoft Bing 3D Cities and Small UAV-based Photogrammetric Data

Optical–SAR Data Fusion Based on Simple Layer Stacking and the XGBoost Algorithm to Extract Urban Impervious Surfaces in Global Alpha Cities

Operational TomoSAR Processing Using TerraSAR-X High Resolution Spotlight Stacks from Multiple View Angles