A Tiny Target and Edge Feature Extraction Algorithm for Semantic Segmentation

Shasha Ren,Qiong Liu,Xiaodong Zhang
DOI: https://doi.org/10.2139/ssrn.4132925
2022-01-01
SSRN Electronic Journal
Abstract:Semantic segmentation is a fundamental computer vision task which is still struggled with tiny targets. One of the important reasons is that existing semantic segmentation algorithms insufficiently gained the detail information from tiny targets and semantic edges. To handle this issue, we present a tiny target and edge feature extraction (T 2 E 2 ) algorithm for semantic segmentation. Especially, we can obtain spatial semantic information at pixel-level by constructing a pixel attention mechanism (PAM) on each decoder layer, which provide high-level feature as a guidance of low-level feature. The Edge Extraction Module (EEM) and the Tiny Target Extraction Module (TTE) are designed to get the feature information from the edges and the tiny target. Both the tiny target feature and the edges are supervised by specific loss functions. Extensive experiments are conducted on Cityscapes, Camvid, VOC2012 and ADE20K which demonstrate the effectiveness of the proposed algorithm. T 2 E 2 Â well embeds the tiny target and edge information, avoids inner contour noise, and surpasses state-of-the-art algorithms by 2%.
What problem does this paper attempt to address?