Abstract:More distinguishable and consistent pixel features for each category will benefit the semantic segmentation under various settings. Existing efforts to mine better pixel-level features attempt to explicitly model the categorical distribution, which fails to achieve optimal due to the significant pixel feature variance. Moreover, prior research endeavors have scarcely delved into the thorough analysis and meticulous handling of pixel-level variances, leaving semantic segmentation at a coarse granularity. In this work, We analyze the causes of pixel-level variance and raise the concept of $\textbf{pixel learning}$ to concentrate on the tailored learning process of pixels, handle pixel-level variance, and enhance the segmentation model's per-pixel recognition capability. Under the context of the pixel learning scheme, each image is viewed as a distribution of pixels, and pixel learning aims to pursue consistent pixel representation inside an image, continuously align pixels from different images (distributions), and eventually achieve consistent pixel representation for each category. We proposed a pure pixel-level learning framework, namely PiXL, which consists of a pixel partition module to divide pixels into sub-domains, a prototype generation, a selection module to prepare targets for subsequent alignment, and a pixel alignment module to guarantee pixel feature consistency intra- and inter-images. Extensive evaluations of multiple learning paradigms, including unsupervised domain adaptation and semi-/fully-supervised segmentation, show that PiXL outperforms state-of-the-art performances, especially when annotated images are scarce. Visualization of the embedding space further demonstrates that pixel learning attains a superior representation of pixel features. The code will be available upon acceptance.

A Learning Model Based On Pixels For Illumination Analysis

Estimation of Illuminant Chromaticity by Linear Fitting Approach

A study of the effect of the illumination model on the generation of synthetic training datasets

Prediction model for indoor light environment brightness based on image metrics

Robust Pixel Classification for 3D Modeling with Structured Light.

Learning to Decouple the Lights for 3D Face Texture Modeling

Effective Learning-Based Illuminant Estimation Using Simple Features

An Adaptive Correspondence Algorithm for Modeling Scenes with Strong Interreflections

Biologically inspired image invariance guided illuminant estimation using shallow and deep models

A Modeling Method for Scene under Lighting Variations

Characterization Of Human Faces Under Illumination Variations Using Rank, Integrability, And Symmetry Constraints

A Novel Illumination-Insensitive Feature Extraction Method

Learning Image Aesthetic Assessment from Object-level Visual Components

Illumination modelling for reconstructing the machined surface topography

Diving Segmentation Model into Pixels

Automatic Illumination Planning for Robot Vision Inspection System.

Spectral calculation model for machine vision image enhancement

DarkGS: Learning Neural Illumination and 3D Gaussians Relighting for Robotic Exploration in the Dark

Detecting Skin Colors under Varying Illumination

Simulating Human Visual Perception in Nighttime Illumination

Learning Efficient Illumination Multiplexing for Joint Capture of Reflectance and Shape