Abstract:Image parsing is vital for many high-level image understanding tasks. Although both parametric and non-parametric approaches have achieved remarkable success, many technical challenges still prevail for images containing things/objects with broad-coverage and high-variability, because it still lacks versatile and effective strategies to seamlessly integrate local-global features selection, contextual cues exploitation, spatial layout encoding, data-driven coherency exploration, and flexible accommodation of newly annotated labels. To ameliorate, this paper develops a novel automatic non-parametric image parsing method with advantages of both parametric and non-parametric methodologies by resorting to new modeling and inferring strategies. The originality of our new approach is to employ sparse-dense reconstruction as a latent learning model to conduct candidate-label probability analysis over multi-level local regions, and synchronously leverage context-specific local-global label confidence propagation and global semantic spatial-contextual cues to guide holistic scene parsing. Towards this goal, we devise several novel technical components to comprise a lightweight parsing framework, including local region representation integrating complementary features, anisotropic consistency propagation based on bi-harmonic distance metric, bottom-up label voting, semantic string generation of image-level spatial-contextual cues based on Hilbert space-filling curve, and co-occurrence priors analysis based on relaxed string matching algorithm, which collectively enable us to effectively combat the aforementioned obstinate problems. Moreover, we conduct comprehensive experiments on public benchmarks, and make extensive and quantitative evaluations with state-of-the-art methods, which demonstrate the advantages of our method in accuracy, versatility, flexibility, and efficiency.

Deep Structured Scene Parsing by Learning with Image Descriptions

Hierarchical Scene Parsing by Weakly Supervised Learning with Image Descriptions

Geometric Scene Parsing with Hierarchical LSTM

Multi-layer Feature Aggregation for Deep Scene Parsing Models

Weakly-supervised Scene Parsing with Multiple Contextual Cues

SPNet: Superpixel Pyramid Network for Scene Parsing

Recurrent Convolutional Neural Networks for Scene Parsing

Scene Parsing Via Integrated Classification Model and Variance-Based Regularization.

HSNet: Hierarchical Semantics Network for Scene Parsing

Scene Parsing Using Inference Embedded Deep Networks

Semantic Combined Network for Zero-Shot Scene Parsing.

Scene Parsing with Multiscale Feature Learning, Purity Trees, and Optimal Covers

Generalized Label-Efficient 3D Scene Parsing via Hierarchical Feature Aligned Pre-Training and Region-Aware Fine-tuning

HDPA: Hierarchical Deep Probability Analysis for Scene Parsing

Structural inference embedded adversarial networks for scene parsing

Ke-Gan: Knowledge Embedded Generative Adversarial Networks For Semi-Supervised Scene Parsing

Automatic non-parametric image parsing via hierarchical semantic voting based on sparse-dense reconstruction and spatial-contextual cues.

Objectness Region Enhancement Networks for Scene Parsing

Scene Graph Parsing as Dependency Parsing

Design of visual communication based on deep learning approaches

Toward Achieving Robust Low-Level and High-Level Scene Parsing