Abstract:More distinguishable and consistent pixel features for each category will benefit the semantic segmentation under various settings. Existing efforts to mine better pixel-level features attempt to explicitly model the categorical distribution, which fails to achieve optimal due to the significant pixel feature variance. Moreover, prior research endeavors have scarcely delved into the thorough analysis and meticulous handling of pixel-level variances, leaving semantic segmentation at a coarse granularity. In this work, We analyze the causes of pixel-level variance and raise the concept of $\textbf{pixel learning}$ to concentrate on the tailored learning process of pixels, handle pixel-level variance, and enhance the segmentation model's per-pixel recognition capability. Under the context of the pixel learning scheme, each image is viewed as a distribution of pixels, and pixel learning aims to pursue consistent pixel representation inside an image, continuously align pixels from different images (distributions), and eventually achieve consistent pixel representation for each category. We proposed a pure pixel-level learning framework, namely PiXL, which consists of a pixel partition module to divide pixels into sub-domains, a prototype generation, a selection module to prepare targets for subsequent alignment, and a pixel alignment module to guarantee pixel feature consistency intra- and inter-images. Extensive evaluations of multiple learning paradigms, including unsupervised domain adaptation and semi-/fully-supervised segmentation, show that PiXL outperforms state-of-the-art performances, especially when annotated images are scarce. Visualization of the embedding space further demonstrates that pixel learning attains a superior representation of pixel features. The code will be available upon acceptance.

Pixel Re-Representations for Better Classification of Images

Object-Centred Image Representation Based on Spatial Pyramid

SUBPIXEL MAPPING OF HYPERSPECTRAL IMAGE BASED ON LINEAR SUBPIXEL FEATURE DETECTION AND OBJECT OPTIMIZATION

A-Optimal Projection for Image Representation.

A simple and effective postprocessing method for image classification

Fast Low Rank Representation Based Spatial Pyramid Matching for Image Classification.

Superpixel-Based Long-Range Dependent Network for High-Resolution Remote-Sensing Image Classification

An image representation method based on the similarity of feature points

Image Classification Method Rationally Utilizing Spatial Information of the Image

Image Classification via Object-Aware Holistic Superpixel Selection

Hyperspectral Image Classification Via Joint Sparse Representation of Multi-layer Superpixles.

Feature Intensification Using Perception-Guided Regional Classification for Remote Sensing Image Super-Resolution

Efficient Representation of Natural Image Patches

Learning a Discriminative Projection and Representation for Image Classification

2D-PCA Representation and Sparse Representation for Image Recognition

Diving Segmentation Model into Pixels

Robust low-rank representation via residual projection for image classification

Local Low-Rank Approximation With Superpixel-Guided Locality Preserving Graph for Hyperspectral Image Classification

Pixel-Wise Classification Method For High Resolution Remote Sensing Imagery Using Deep Neural Networks

A remote sensing image classification method based on sparse representation

An Effective Classification Method for Hyperspectral Image With Very High Resolution Based on Encoder–Decoder Architecture