Abstract:Humans are able to recognize structured relations in observation, allowing us to decompose complex scenes into simpler parts and abstract the visual world at multiple levels. However, such hierarchical reasoning ability of human perception remains largely unexplored in current literature of semantic segmentation. Existing works are often aware of flatten labels and distinguish all the semantic categories exclusively for each pixel. In this work, we instead address hierarchical semantic segmentation (HSS), with the aim of providing a structured, pixel-wise description of visual observation in terms of a class hierarchy. We devise Hssn , a general HSS framework that tackles two critical issues in this task: i) how to efficiently adapt existing hierarchy-agnostic segmentation networks to the HSS setting, and ii) how to leverage the class hierarchy to regularize HSS network learning. To address i) , Hssn directly casts HSS as a pixel-wise multi-label classification task, only bringing minimal architecture change to current segmentation models. To solve ii) , Hssn first explores inherent properties of the hierarchy as a training objective, which enforces segmentation predictions to obey the hierarchy structure. Furthermore, with a set of hierarchy-induced margin constraints, Hssn efficiently reshapes the learned pixel embedding space, so as to generate hierarchy-aware pixel representations and facilitate structured segmentation eventually. Building upon Hssn , we further exploit the mutual exclusion relation between semantic labels and strengthen the margin based regularization strategy with more meaningful constrains, leading to Hssn +, a more effective framework for HSS. We conduct extensive experiments on six semantic segmentation datasets (i.e., Mapillary Vistas 2.0, Cityscapes, LIP, PASCAL-Person-Part, PASCAL-Part-58, and PASCAL-Part-108), with different class hierarchies, network architectures, and backbones, and the results confirm the generalization and superiority of our algorithms.

Intelligent Segmentation Framework and Data Hierarchy of Chinese Language and Literature Based on Semantic Recognition

Segmentation of Chinese Discourse in Content-Based Information Retrieval.

A Discriminative Latent Variable Chinese Segmenter with Hybrid Word/Character Information.

A Semantic Framework for Chinese Historical Events Based on Linked Data and Knowledge Graph.

Processing of Chinese language and text information system under the background of speech recognition

Semantic Role Labeling Integrated with Multilevel Linguistic Cues and Bi-LSTM-CRF

Parsing-based Chinese word segmentation integrating morphological and syntactic information

Semantic Hierarchy-Aware Segmentation

Domain-Aware Word Segmentation for Chinese Language: A Document-Level Context-Aware Model

Word Segmentation for Chinese Novels

LCSegNet: An Efficient Semantic Segmentation Network for Large-Scale Complex Chinese Character Recognition

Deep Learning for Chinese Word Segmentation and POS Tagging.

A General Framework For Multi-Character Segmentation And Its Application In Recognizing Multilingual Asian Documents

Word Segmentation for Chinese Judicial Documents

Automatic sentence segmentation for classical Chinese: The Spring and Autumn Annals as an example

Chinese word segmentation as morpheme-based lexical chunking

A Sentence Segmentation Method for Ancient Chinese Texts Based on NNLM.

Deep Hierarchical Semantic Segmentation

Automatic Labeling of Semantic Clauses in Research Articles

Binary Tree based Chinese Word Segmentation

Semantic Analysis and Structured Language Models