Abstract:Downsampling, which aims to improve computational efficiency by reducing the spatial resolution of feature maps, is a critical operation in neural networks. Many downsampling methods have been proposed to address the challenge of retaining feature map information. However, some detailed information is still lost, even though these methods can extract features with stronger semantics. In this paper, we propose a novel downsampling method which combines feature slicing and depthwise separable convolution for information-retaining downsampling. It slices the input feature map into multiple non-overlapping sub-feature maps by using indexes with a stride of two in the spatial dimension and applies depthwise separable convolution on each slice to extract feature information. To demonstrate the effectiveness of SliceSamp, we compare it with classical downsampling methods on image classification, object detection, and semantic segmentation tasks using several benchmark datasets, including ImageNet-1K, COCO, VOC, and ADE20K. Extensive experiments demonstrate that SliceSamp outperforms classical downsampling methods with consistent improvements in various computer vision tasks. The proposed SliceSamp shows advanced model performance with lower computational costs and memory requirements. By replacing the downsampling layers in different network architectures (including ResNet (Residual Network), YOLOv5, and Swin Transformer), SliceSamp brings different degrees of performance gains (+0.54~3.64%) compared to these baseline models. Additionally, SliceUpsamp enables high-resolution feature reconstruction and alignment during upsampling. SliceSamp and SliceUpsamp can be plug-and-play-integrated into existing neural network architectures. As a promising downsampling alternative to traditional methods, SliceSamp can also provide a reference for designing lightweight and high-performance model architectures in the future.

Semantically-Adaptive Upsampling for Layout-to-Image Translation

Integrating Spatial Prior Adapter for Enhancing SAM Performance in Medical Image Segmentation

ADeLA: Automatic Dense Labeling with Attention for Viewpoint Shift in Semantic Segmentation

An Adaptive Random Compressive Partial Sampling Method with TV Recovery

LDA-AQU: Adaptive Query-guided Upsampling via Local Deformable Attention

Learning to Upsample by Learning to Sample

SAPA: Similarity-Aware Point Affiliation for Feature Upsampling

More than Encoder: Introducing Transformer Decoder to Upsample

Semantic Segmentation Network Using Local Relationship Upsampling for Remote Sensing Images

Semantic Image Synthesis with Spatially-Adaptive Normalization

Semantic Point Cloud Upsampling

Adaptive Sampling and Reconstruction for Gradient-Domain Rendering

Image Synthesis from Layout with Locality-Aware Mask Adaption

Learning Spatio-Temporal Downsampling for Effective Video Upscaling

Content Adaptive Constraint Based Image Upsampling.

An Adaptive Sampling Scheme to Efficiently Train Fully Convolutional Networks for Semantic Segmentation

SliceSamp: A Promising Downsampling Alternative for Retaining Information in a Neural Network

A pixel and channel enhanced up-sampling module for biomedical image segmentation

Local and Global GANs with Semantic-Aware Upsampling for Image Generation

PLACE: Adaptive Layout-Semantic Fusion for Semantic Image Synthesis

Optimized Image Up-Scaling From Learning Selective Similarity