A CNN for the Identification of Corresponding Patches in SAR and Optical Imagery of Urban Scenes

Lichao Mou,Michael Schmitt,Yuanyuan Wang,Xiao Xiang Zhu
DOI: https://doi.org/10.1109/jurse.2017.7924548
2017-01-01
Abstract:In this paper we propose a convolutional neural network (CNN), which allows to identify corresponding patches of very high resolution (VHR) optical and SAR imagery of complex urban scenes. Instead of a siamese architecture as conventionally used in CNNs designed for image matching, we resort to a pseudo-siamese configuration with no interconnection between the two streams for SAR and optical imagery. The network is trained with automatically generated training data and does not resort to any hand-crafted features. First evaluations show that the network is able to predict corresponding patches with high accuracy, thus indicating great potential for further development to a generalized multi-sensor matching procedure.
What problem does this paper attempt to address?