Abstract:Recently, there is growing attention on one-stage panoptic segmentation methods which aim to segment instances and stuff jointly within a fully convolutional pipeline efficiently. However, most of the existing works directly feed the backbone features to various segmentation heads ignoring the demands for semantic and instance segmentation are different: The former needs semantic-level discriminative features, while the latter requires features to be distinguishable across instances. To alleviate this, we propose to first predict semantic-level and instance-level correlations among different locations that are utilized to enhance the backbone features, and then feed the improved discriminative features into the corresponding segmentation heads, respectively. Specifically, we organize the correlations between a given location and all locations as a continuous sequence and predict it as a whole. Considering that such a sequence can be extremely complicated, we adopt Discrete Fourier Transform (DFT), a tool that can approximate an arbitrary sequence parameterized by amplitudes and phrases. For different tasks, we generate these parameters from the backbone features in a fully convolutional way which is optimized implicitly by corresponding tasks. As a result, these accurate and consistent correlations contribute to producing plausible discriminative features which meet the requirements of the complicated panoptic segmentation task. To verify the effectiveness of our methods, we conduct experiments on several challenging panoptic segmentation datasets and achieve state-of-the-art performance on MS COCO with $45.1$\% PQ and ADE20k with $32.6$\% PQ.

A Criterion Based on Fourier Transform for Segmentation of Connected Digits.

A New Distinguishing Algorithm of Connected Character Image Based on Fourier Transform.

Chinese Handwriting Identification Based on Stable Spectral Feature of Texture Images

Space Handwriting Character Recognition Method Based on Elimination of Connected Stroke

Time-frequency Optimal Feature Extraction Method Based on SFFS Algorithm for Defects Recognition

Spectral analysis for face recognition

Integrating Data-Driven Segmentation, Local Feature Extraction and Fisher Kernel Encoding to Improve Time Series Classification

Image Segmentation Based On Local Fourier Coefficients Histogram

Fingerprint Segmentation Based on Local Fourier Transform

Texture Segmentation Using Kernel-based Techniques

A Recognition Based System for Segmentation of Touching Handwritten Numeral Strings

&Lt;title>fourier Properties of Fingerprints</title>

High-Precision Dichotomous Image Segmentation With Frequency and Scale Awareness

Research on Automatic Recognition of Unconstratined Handwritten Digits

Weighted Sparse Fusion for FV and FDT Identification

A Fourier Descriptor of 2D Shapes Based on Multiscale Centroid Contour Distances Used in Object Recognition in Remote Sensing Images

Efficient and real-time skin lesion image segmentation using spatial-frequency information and channel convolutional networks

A top-down fingerprint image enhancement method based on fourier analysis

FFD: Fast Feature Detector

A Frequency Domain Feature-Guided Network for Semantic Segmentation of Remote Sensing Images

CFNet: Learning Correlation Functions for One-Stage Panoptic Segmentation