Abstract:Enlarging the spatial resolution of features generated by fully convolutional networks (FCNs) can improve the performance of semantic segmentation. To achieve this goal, deeper network with deconvolutional structure can be applied. However, when the network architecture becomes more complex, the training efficiency may degrade. To address the joint optimization problem of improving spatial resolution through deeper networks and training deeper networks more effectively, we propose a Fully Convolutional Residual Continuous CRF Network (FC-RCCN) for semantic segmentation. FC-RCCN is composed of three subnetworks: a unary network, a pairwise network, and a superpixel based continuous conditional random filed (C-CRF) network. In order to generate full spatial resolution predictions with high-quality, a residual block based unary network with multi-scale features fusion is proposed. Even though the unary network is a deeper network, the whole framework can be trained effectively in an end-to-end way using the joint pixel-level and superpixel-level supervised learning strategy which is optimized by a pixel-level softmax cross entropy loss and a superpixel-level log-likelihood loss. Besides, C-CRF inference is fused with pixel-level prediction during the test procedure, which guarantees the method's robustness to the superpxiel errors. In the experiments, we evaluatee the power of the three subnetworks and the learning strategy comprehensively. Experiments on three benchmark datasets demonstrate that the proposed FC-RCCN outperforms previous segmentation methods and obtains the state-of-the-art performance. (C) 2018 Elsevier B.V. All rights reserved.

Fully Convolutional Instance-Aware Semantic Segmentation

Translation-aware Fully Convolutional Instance Segmentation

Real-time Semantic Segmentation with Weighted Factorized-Depthwise Convolution

Fully Convolutional Neural Networks With Full-Scale-Features For Semantic Segmentation

Fully Convolutional Networks for Semantic Segmentation

Instance-aware Semantic Segmentation via Multi-task Network Cascades

Image semantic segmentation based on FCN-CRF model

Fully Convolutional Pyramidal Networks for Semantic Segmentation.

Parallel Fully Convolutional Network for Semantic Segmentation

FC-RCCN: Fully Convolutional Residual Continuous CRF Network for Semantic Segmentation

Mask R-Cnn With Feature Pyramid Attention For Instance Segmentation

Dense Convolutional Networks for Semantic Segmentation.

A Semantic Segmentation Algorithm Using FCN with Combination of BSLIC

Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs

Mask-R-FCN: A Deep Fusion Network for Semantic Segmentation.

A New Multi-Channel Deep Convolutional Neural Network for Semantic Segmentation of Remote Sensing Image.

A Top-Down Manner-Based DCNN Architecture for Semantic Image Segmentation.

Instance Semantic Segmentation via Scale-Aware Patch Fusion Network.

A Hybrid Semantic Segmentation Based on Level-Set Evolution Driven by Fully Convolutional Networks

Partial Atrous Cascade R-CNN

Semantic Segmentation via Highly Fused Convolutional Network with Multiple Soft Cost Functions