Abstract:Nowadays, advanced sensor technology and image processing algorithms allow us to measure different aspects of the objects on the Earth’s surface, from spectral characteristics in optical images, height information in LiDAR data, to spatial information generated by image processing technologies like commercial software eCognition®. However, automatic recognition of objects in remote sensed scenes remains challenging. It is clear that single technology might not be sufficient to obtain reliable classification results (Debes, 2014). Multisensor data, once combined, can contribute to a more comprehensive interpretation of objects on the ground. For example, spectral reflections from optical image cannot recognize objects under shadows, while they can often be easily detected by LiDAR data. On the other hand, LiDAR data alone may fail to discriminate between objects that are quite similar in height.Stacking multi-source data together is a widely applied data fusion technique for classification. These methods first apply feature extraction on each individual data source, after which all feature sources are concatenated into one stacked vector for classification. While such methods are appealing due to their simplicity, they do not always perform better than using a single data source. This is because the value of different components in the stacked feature vector can be significantly unbalanced. As a consequence, theinformation contained by different data sources is not equally represented or measured. Furthermore, the increase in the dimensionality of the stacked features, combined with the limited number of labelled samples, may together lead to the problem of the “curse of dimensionality” (Liao, 2015).Therefore, we present a local graph fusion method to fuse true orthophoto and LiDAR image for urban object recognition. First, object-based spatial and height information are generated on true orthophoto and LiDAR image, respectively. Second, we build a local fusion graph within a sliding window where only the data points with similar spatial and height characteristics are connected. Finally, we solve the problem of multisensor data fusion by projecting multisensor data into a subspace, on which the advantages ofdifferent data sources are well exploited. Experimental results on fusion of true orthophoto and LiDAR image from 'ISPRS Test Project on Urban Classification and 3D Building Reconstruction' demonstrate the potential of the proposed method. Compared to the methods using only single data source or stacking them together, our approach has significant improvements in overall classification accuracy. Both the method’s details and the results of a comprehensive test will be presented at GEOBIA 2016.

Fusion of Hyperspectral and LiDAR Data Using Sparse and Low-Rank Component Analysis

Fusion Of Hyperspectral And Lidar Remote Sensing Data Using Multiple Feature Learning

LiDAR-Guided Cross-Attention Fusion for Hyperspectral Band Selection and Image Classification

Relative Total Variation Structure Analysis-Based Fusion Method for Hyperspectral and LiDAR Data Classification

Fusion of Hyperspectral and Lidar Data Using Generalized Composite Kernels: A Case Study in Extremadura, Spain

Classification of hyperspectral and LIDAR data using extinction profiles with feature fusion

Multi-Scale Feature Extraction and Total Variation Based Fusion Method for HSI and Lidar Data Classification

Semi-Supervised Graph Fusion of Hyperspectral and Lidar Data for Classification

A Novel Feature Fusion Approach for VHR Remote Sensing Image Classification

Hyperspectral and LiDAR Data Classification Using Spatial Context and De-Redundant Fusion Network.

Hyperspectral and lidar data integration and classification

Image Fusion for Spatial Enhancement of Hyperspectral Image via Pixel Group Based Non-Local Sparse Representation

Fusion of optical and liDAR images for urban objects recognition

Fusion Of Hyperspectral And Lidar Data Using Morphological Component Analysis

Multispectral and SAR Image Fusion Based on Laplacian Pyramid and Sparse Representation

Hyperspectral and LiDAR Data Fusion Classification Using Superpixel Segmentation-Based Local Pixel Neighborhood Preserving Embedding

Hyperspectral and Multispectral Image Fusion via Nonlocal Low-Rank Tensor Approximation and Sparse Representation

Classification of Hyperspectral and LiDAR Data Using Coupled CNNs

Hyperspectral Restoration and Fusion With Multispectral Imagery via Low-Rank Tensor-Approximation

Decision Fusion Based On Joint Low Rank And Sparse Component For Hyperspectral Image Classification