Few-Shot Semantic Segmentation with Dynamic Weights Transfer Network

Caiye Deng,Yong Wang
DOI: https://doi.org/10.1109/ICSP58490.2023.10248674
2023-01-01
Abstract:Few-shot semantic segmentation (FSS) has been getting noticed by its can segment unseen object classes of a few support samples. Most existing algorithms use some method to obtain the correlation between the support set and the query set to calculate the prediction mask, such as cosine distance or global mean pooling (GAP). However, it is difficult for these algorithms to achieve dynamic interaction between support set characteristics and query set characteristics. Therefore, we proposed a Dynamic Weights Transfer Network (DWTN), to dynamically implement the desirable interaction of the support set with query set. In DWTN, we propose three modules, Weight Generation Module (WGM), Inner Loop Module (ILM), and Outer Loop Module (OLM). WGM generates the dynamic weights from the query set images. ILM trains the weights. OLM obtains the prediction mask. Experiments on PASCAL-5i at 1-shot and 5-shot settings show that our proposed DWTN has simpler meta-learning and superior performance as a new solution with few-shot semantic segmentation.
What problem does this paper attempt to address?