Abstract:Existing semantic segmentation networks perform well in accuracy by spending much computation. However, for practical applications, not only high segmentation accuracy but also high inference speed is required. To solve the problem of the difficult balance between accuracy and speed, we propose a new real-time semantic segmentation network (FBRNet). To extract multi-scale semantic information more quickly, we propose a lightly weighted reinforced atrous spatial pyramid pooling module (arASPP) based on the attention mechanism, which can extract richer and more advanced features with less computation than the original ASPP. To eliminate the semantic gap between high- and low-level features, we propose a new feature fusion module (CSFM), in which a shuffling mechanism is introduced to enhance robustness, and a parallel contextual information enhancement module and detail information enhancement module are built to facilitate the information exchange between high- and low-level features, achieving the effect of improving the model feature representation. Finally, we also introduce high-level features, fusing Laplace convolution and spatial attention mechanisms, and design the edge feature reinforcement module (LABRM) to eliminate the noise of low-level features and compensate for the model's segmentation effect target boundary. In the Cityscapes validation set and test set, FBRNet achieves 77.63% and 75.3% mIoU, and 101.9 FPS on a single tesla-T4 GPU, also achieved 72.4% mIoU and 89.8 FPS on the CamVid dataset and 55.2% mIoU and 100.8 FPS on the BDD100K dataset, which is a better balance of accuracy and speed compared with existing networks. The code is available at https://github.com/little5570/FBRNet.

Boundary-Aware Network for Fast and High-Accuracy Portrait Segmentation

Boundary-Aware Segmentation Network for Mobile and Web Applications

BENet: boundary-enhanced network for real-time semantic segmentation

DRBANET: A Lightweight Dual-Resolution Network for Semantic Segmentation with Boundary Auxiliary

Improving Image Segmentation with Boundary Patch Refinement

A Boundary Guided Cross Fusion Approach for Remote Sensing Image Segmentation

Fast Portrait Segmentation with Highly Light-weight Network

A Coarse-to-Fine Instance Segmentation Network with Learning Boundary Representation

Boundary-Guided Lightweight Semantic Segmentation With Multi-Scale Semantic Context

Faster BiSeNet: A Faster Bilateral Segmentation Network for Real-time Semantic Segmentation.

BES-Net: Boundary Enhancing Semantic Context Network for High-Resolution Image Semantic Segmentation

Boundary Knowledge Translation Based Reference Semantic Segmentation

Boundary Guidance Hierarchical Network for Real-Time Tongue Segmentation

A Two-Pipeline Instance Segmentation Network via Boundary Enhancement for Scene Understanding

Boundary-Aware Instance Segmentation

Attention based lightweight asymmetric network for real-time semantic segmentation

FBRNet: a feature fusion and border refinement network for real-time semantic segmentation

Very Fast Semantic Image Segmentation Using Hierarchical Dilation and Feature Refining

BASNet: Boundary-Aware Salient Object Detection

Boundary-enhanced dual-stream network for semantic segmentation of high-resolution remote sensing images

BAProto: Boundary-Aware Prototype for High-quality Instance Segmentation.