Body Joint Boundary Prototype Match for Few-Shot Remote Sensing Semantic Segmentation
Yong-Qiang Mao,Zhizhuo Jiang,Yu Liu,Yiming Zhang,Yaowen Li,Chenggang Yan,Bolun Zheng
DOI: https://doi.org/10.1109/lgrs.2024.3464549
IF: 5.343
2024-10-04
IEEE Geoscience and Remote Sensing Letters
Abstract:Deep networks require a large number of samples for optimization, so few-shot segmentation in remote sensing scenes is still an open problem. However, this challenge is exacerbated by the feature blurring and aliasing of bodies (low frequency) and boundaries (high frequency). The existing methods usually only focus on the body part of the class, that is, the low-frequency part, and ignore the critical role of boundary information, that is, high-frequency details, on feature representation. In this letter, we propose a novel body joint boundary prototype match (B2PM) approach that aims to enable prior learning of low- and high-frequency information by explicitly modeling the body and boundary features of objects. First, body-aware prototype learning (BodyPL) realizes the adaptive modeling of the body part of the object through a precise farthest point sampling (FPS) initialization algorithm and an adaptive part shift (APS) strategy, which alleviates the feature ambiguity of the body. Second, boundary-aware prototype learning (BoundPL) explicitly models boundary prototypes by building a patch division and assignment strategy to alleviate feature aliasing at boundaries. Finally, prototype match performs prior knowledge aggregation by computing the affinity between query features and support prototypes. Extensive experiments on commonly used benchmarks (iSAID and PASCAL VOC) demonstrate that B2PM improves the state of the art by significant margins.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics