Multitarget Domain Adaptation Building Instance Extraction of Remote Sensing Imagery With Domain-Common Approximation Learning
Fayong Zhang,Kejun Liu,Yuanyuan Liu,Chaofan Wang,Wujie Zhou,Hongyan Zhang,Lizhe Wang
DOI: https://doi.org/10.1109/tgrs.2024.3376719
IF: 8.2
2024-04-05
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Deep learning-based building instance extraction on remote sensing imagery (RSI) has achieved tremendous success under the large-scale labeled training data. However, multitarget domain adaptation building instance extraction (MD-BIE) is still a challenge task that involves transferring knowledge from a source domain to multiple unlabeled target domains, which poses various semantic gaps between and within multiple domains, e.g., style, illumination, resolution, density, and scale. Most current methods for single-target domain adaptation are not applicable to the more realistic MD-BIE task. To this end, we propose a novel domain-common approximation learning (DAL) for both modeling intradomain and interdomain adaptation, thus obtaining robust MD-BIE. DAL contains three main modules: multidomain style transfer (MST), multidomain feature approximation (MFA), and multidomain cascaded instance extraction (MCIE). To alleviate the semantic gaps between multiple domains for interdomain adaptation, we first employ the MST to learn multiple target-domain-like features that preserve both the styles of target domains and the content of the source domain, and then use the MFA to approximate these features toward a central domain-common space, thus producing domain-common semantic representations. Moreover, we develop the MCIE with hierarchical extraction losses for intradomain adaptation to extract precise building instance contours from the domain-common semantic representations, further eliminating the potential gaps within multiple domains. By colearning these three modules in an end-to-end manner, the DAL bridges the semantic gaps between and within multiple domains. Extensive experiments on different popular MD-BIS tasks (SAB Crowd & WHU, Crowd SAB & WHU, SAB Crowd & SAB & WHU, and SAB WHU) show that our DAL outperforms the current methods by a significant margin.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics