Abstract:Perceptual organization is a challenging visual task that aims to perceive and group the individual visual element so that it is easy to understand the meaning of the scene as a whole. Most recent methods building upon advanced Convolutional Neural Network (CNN) come from learning discriminative representation and modeling context hierarchically. However, when the visual appearance difference between foreground and background is obscure, the performance of existing methods degrades significantly due to the visual ambiguity in the discrimination process. In this paper, we argue that the figure-ground assignment mechanism, which conforms to human vision cognitive theory, can be explored to empower CNN to achieve a robust perceptual organization despite visual ambiguity. Specifically, we present a novel Figure-Ground-Aided (FGA) module to learn the configural statistics of the visual scene and leverage it for the reduction of visual ambiguity. Particularly, we demonstrate the benefit of using stronger supervisory signals by teaching (FGA) module to perceive configural cues, \ie, convexity and lower region, that human deem important for the perceptual organization. Furthermore, an Interactive Enhancement Module (IEM) is devised to leverage such configural priors to assist representation learning, thereby achieving robust perception organization with complex visual ambiguities. In addition, a well-founded visual segregation test is designed to validate the capability of the proposed FGA mechanism explicitly. Comprehensive evaluation results demonstrate our proposed FGA mechanism can effectively enhance the capability of perception organization on various baseline models. Nevertheless, the model augmented via our proposed FGA mechanism also outperforms state-of-the-art approaches on four challenging real-world applications.

FCGNet: Foreground and Class Guided Network for human parsing

CDGNet: Class Distribution Guided Network for Human Parsing

Context-Guided Adaptive Network for Efficient Human Pose Estimation.

Hierarchical Gate Network for Fine-Grained Visual Recognition.

Channel and Spatial Enhancement Network for human parsing

Attention-guided Progressive Partition Network for Human Parsing

Finer-Net: Cascaded Human Parsing with Hierarchical Granularity

Foreground Mask Guided Network For Crowd Counting

MFCP-Net: Multiscale Feature Correlation Perception Network for Image Segmentation Based on Background Prior

GFNet: A Lightweight Group Frame Network for Efficient Human Action Recognition.

Human Pose Prediction Using Interpretable Graph Convolutional Network for Smart Home

SGM-Net: Semantic Guided Matting Net

Quality-Aware Network for Human Parsing

Multi-directional guidance network for fine-grained visual classification

F2Net: Learning to Focus on the Foreground for Unsupervised Video Object Segmentation

Instance-level Human Parsing Via Part Grouping Network.

CGFNet: Cross-Guided Fusion Network for RGB-T Salient Object Detection

A brief introduction to a framework named Multilevel Guidance-Exploration Network

Exploring Figure-Ground Assignment Mechanism in Perceptual Organization

Edge-Sensitive Human Cutout with Hierarchical Granularity and Loopy Matting Guidance.

Understanding Humans in Crowded Scenes: Deep Nested Adversarial Learning and A New Benchmark for Multi-Human Parsing