Abstract:Despite recent advancements in semantic segmentation, where and what pixels are hard to segment remains largely unexplored. Existing research only separates an image into easy and hard regions and empirically observes the latter are associated with object boundaries. In this paper, we conduct a comprehensive analysis of hard pixel errors, categorizing them into three types: false responses, merging mistakes, and displacements. Our findings reveal a quantitative association between hard pixels and aliasing, which is distortion caused by the overlapping of frequency components in the Fourier domain during downsampling. To identify the frequencies responsible for aliasing, we propose using the equivalent sampling rate to calculate the Nyquist frequency, which marks the threshold for aliasing. Then, we introduce the aliasing score as a metric to quantify the extent of aliasing. While positively correlated with the proposed aliasing score, three types of hard pixels exhibit different patterns. Here, we propose two novel de-aliasing filter (DAF) and frequency mixing (FreqMix) modules to alleviate aliasing degradation by accurately removing or adjusting frequencies higher than the Nyquist frequency. The DAF precisely removes the frequencies responsible for aliasing before downsampling, while the FreqMix dynamically selects high-frequency components within the encoder block. Experimental results demonstrate consistent improvements in semantic segmentation and low-light instance segmentation tasks. The code is available at:

Image aliasing-removing based on imaging-mechanism analysis

Aliasing Removing Of Hyperspectral Image Based On Fractal Structure Matching

Aliasing Detection and Reduction Scheme on Angularly Undersampled Light Fields

Aliasing in minification of digital images

Aliasing Detection and Reduction in Plenoptic Imaging

Non-quadratic regularized edge-preserving reconstruction for parallel magnetic resonance image

Comparison of Microscan Model and Optical Prefiltering Model for Aliasing Artifacts Reduction in Discrete Imaging Systems

Quantitative characterization of micro-scanning imaging aliasing and optical parameter optimization

Learning the Frequency Domain Aliasing for Real-World Super-Resolution

Anti-Aliasing for Animation Sequences Based on the Warping Technique of Range Images

Anti-Aliased Rendering of Water Surface

Aliasing Reduction in Discrete Imaging Systems Using Pupil Function Controlling

Anti-aliasing method based on rotated spatial filtering

Aliasing Detection in Rendered Images Via a Multi-Task Learning

Sub-Pixel Anti-Aliasing Via Triangle-Based Geometry Reconstruction

Analysis and Removal of Acoustic Rolling Shutter Effect

Image Anti-Aliasing Techniques for Internet Visual Media Processing: a Review

Anti Aliasing Technique in Small Object Surface Measurement

When Semantic Segmentation Meets Frequency Aliasing

On the Aliasing Artifacts in Airect Aourier Methods

A method for suppressing spectrum aliasing of off-axis digital holograms based on Kronecker interpolation and backpropagation