Abstract:Perceptual organization is a challenging visual task that aims to perceive and group the individual visual element so that it is easy to understand the meaning of the scene as a whole. Most recent methods building upon advanced Convolutional Neural Network (CNN) come from learning discriminative representation and modeling context hierarchically. However, when the visual appearance difference between foreground and background is obscure, the performance of existing methods degrades significantly due to the visual ambiguity in the discrimination process. In this paper, we argue that the figure-ground assignment mechanism, which conforms to human vision cognitive theory, can be explored to empower CNN to achieve a robust perceptual organization despite visual ambiguity. Specifically, we present a novel Figure-Ground-Aided (FGA) module to learn the configural statistics of the visual scene and leverage it for the reduction of visual ambiguity. Particularly, we demonstrate the benefit of using stronger supervisory signals by teaching (FGA) module to perceive configural cues, \ie, convexity and lower region, that human deem important for the perceptual organization. Furthermore, an Interactive Enhancement Module (IEM) is devised to leverage such configural priors to assist representation learning, thereby achieving robust perception organization with complex visual ambiguities. In addition, a well-founded visual segregation test is designed to validate the capability of the proposed FGA mechanism explicitly. Comprehensive evaluation results demonstrate our proposed FGA mechanism can effectively enhance the capability of perception organization on various baseline models. Nevertheless, the model augmented via our proposed FGA mechanism also outperforms state-of-the-art approaches on four challenging real-world applications.

Figure-ground Image Generation Using Contour Matching and Rigid Shape Deformation.

Generating Ambiguous Figure-Ground Images

Novel 3D-Aware Composition Images Synthesis for Object Display with Diffusion Model.

Replacement of Facial Parts in Images.

The Artwork Generating System of Escher-Like Positive and Negative Pattern Evolution

Generative Photomontage

Synthesizing Emerging Images from Photographs

Contour-guided Image Completion with Perceptual Grouping

Emerging Images

Deformable Geometry Based Semantic Reconstruction from Scene Graphs.

Pose Guided Image Generation from Misaligned Sources Via Residual Flow Based Correction

Exploring Figure-Ground Assignment Mechanism in Perceptual Organization

Pose Guided Image Generation from Misaligned Sources via Residual Flow Based Correction

Photo2Relief: Let Human in the Photograph Stand Out

Anamorphic Image Generation Using Hybrid Texture Synthesis

RealisHuman: A Two-Stage Approach for Refining Malformed Human Parts in Generated Images

From Parts to Whole: A Unified Reference Framework for Controllable Human Image Generation

MaGRITTe: Manipulative and Generative 3D Realization from Image, Topview and Text

Anamorphic Image Generation Using Hybrid Texture Syn- Thesis

Structure-aware Person Image Generation with Pose Decomposition and Semantic Correlation.

Fully Automatic Figure-Ground Segmentation Algorithm Based on Deep Convolutional Neural Network and GrabCut